I've had some success using MeGUI to resample large mkv files down to around 4GB and tsMuxeR to create Blu-ray disks that play in my Sony BDP-S301 player. Sometimes (> 50% of the time), the disk loads in the player, but won't play. The display says "1:00:00:00" and then says "AVCHD". I use the following procedure:
1. Using the AviSynth script creator, I load the original mkv file to MeGUI for video encoding.
2. I select "x264: Standalone-Blu-ray_Fast" encoder setting, file format "MKV". I leave the encoder settings at default (Turbo, Automated 2pass, AVC Profile: High, AVC Level 4.1), and adjust the bitrate appropriately to get the desired file size. This generates a new mkv file with only the video stream.
3. In tsMuxeR GUI, I add the new mkv file for the video stream. I also add the original mkv file for the audio stream (I uncheck the video track in the original file). I select Output: Create Blu-ray disk and Change level: 4.1.
4. Then I use ImgBurn to burn the resulting BDMV and CERTIFICATE folders on a DVD5 with UDF 2.5 format.
The resulting DVD plays in my Blu-ray player sometimes, but most of the time, I add a coaster to my collection as described above.
Any ideas on what I might be doing wrong will be much appreciated...