Challenges GD, faster than its smaller capacity than it

Discussion in 'Sega Dreamcast Development and Research' started by yzb37859365, Jul 19, 2014.

  1. yzb37859365

    yzb37859365 Spirited Member

    Joined:
    Jul 14, 2013
    Messages:
    187
    Likes Received:
    124
    Challenges GD, faster than its smaller size than it

    sorry,my bad English T_T

    Recently
    Igraduallymade ​​somemodificationsforoptimizingmirrorreads,preliminary test resultsthe effect is obvious,but toperfectthe perfectmirrorofthesewordshaveneeded more timeto test,I am a mannot so much timeinthe


    Sosend apaste,ifthe followingoptimizationmirrorsand gamescan bea lot offriends who are interestedto test,there isa problem, pleasePMme




    First isthe principleunder

    dcread the discinside the fileisfar behindthe speed ofthe memoryoperation speed,so thefiles are compressedto reduce thenumber of read, and thendecompressin memory,thisacceleration effectis veryobvious,soI alwayscomefor thesedooptimization


    Afterthatprinciple, you should beaware of the followingsituationsarenotoptimized

    1 gamefileitself isa compressedoruncompressed and compressedbefore and afterabout the sizeofsuchShenmueseriesAlone in the Dark4.....(originaldocumentitself iscompressed,thepressure ofalittle effect,unless the originalgame'scompressionwaypoor)

    2 filescan not be compressedsuch asinstantreadCGanimationADXsound(withoutmemory,read directlyintomemoryand soundmemory)

    3 segmentedread,pictures aresomanypvr pvm(read onlypart ofeach)


    Compressionhas been doneto optimizethe list of games:


    Black Matrix AD -good and evilFantasia(80minfull version)Japanese version


    Biohazard_CVVeronicamodified version ofthe Chinese versionChinese


    De La Jet Set Radio -graffitimodified version of theJapanese version ofthe enhanced version


    Daytona USA 2001 -Sleepwalking2001U.S.optimized versionJapanese version


    Eternal Arcadia -Arcadia700mtimelessbeauty ofthe fullbetaversion, Japanese version


    Fushigi no Dungeon -windresistant700Mfull versionJapanese version


    IZUMO -IzumoWars(80min)full versionJapanese version


    KOF99modified version of theJapanese version


    NAPPLE _TALE -DaydreamStory(full version+ ripversion)Japanese version


    Spawn - In the Demon's Hand -Spawnfinishedmodified version ofthe Chinese version


    Vampire Chronicle for Matching Service -DemonWarriorsChronicle700Mfull versionJapanese version










    The following is adc sdcardcfcardhard drivewith amirror(docdicanburn imagesto download)



    http://bbs.chinaemu.org/read-htm-tid-95151.html




    LAST_BLADE2last blade2modified versionJapanese version



    POWER_STONE2energygemtwomodified version ofthe U.S. version



    segaboxJapanese version






    Marvel vs. Capcom 2U.S. version





    Street Fighter Zero 3Japanese version ofStreet FighterZERO3







    Zombie RevengeZombieRevengemodified version ofthe U.S. version





    Fighting Vipers 2FightingSnakeon the 2ndedition





    Silent ScopesilentsniperJapanese version





    Virtua Striker 2 VRshooter2U.S. version




    Crazy TaxiCrazy TaxiDayEdition









    Unpublished/production:


    Dead or Alive2

    Zerogunman

    NamayLulu

    capcom vs PsikyoMahjong

    HARUSAME_YOUBIrainYao day

    HEAVY_METAL_GEOMATRIXheavy metal

    ORANGE_POCKET

    Roommate_Novel-Yuka_Sato

    Shutokou Battle 2CapitalHigh 2

    Trizeal

    Triggerheart Exelica

    VR3TBsoldiers

    ................................

    中文:

    最近一段时间陆续做了一些针对优化读取的修改镜像,初步测试结果效果明显,但是要完善完美这些镜像的话还得需要更多的时间来测试,我一个人是没那么多时间的了[​IMG]


    所以发个贴,如果对下面优化镜像和游戏有兴趣的同学可以多多测试,有问题回帖报错




    先来说下原理

    dc读取光盘里面的文件速度是远远赶不上内存的运算速度的,所以把文件压缩减少读取的次数,然后在内存中再解压,这个加速效果还是很明显的,所以我都是针对这些来做的优化


    知道原理以后,应该就知道下列几种情况是不能优化的

    1 游戏文件本身就是压缩过的或者压缩前和压缩后大小差不多的 比如莎木系列 鬼屋魔影4.....(原文件本身就压缩过的,在压一次效果不大,除非原游戏的压缩方式很差)

    2 即时读取的文件不能压缩 比如CG动画 ADX 声音 (不经过内存,直接读取到显存和声音内存)


    3 分段读取的,很多pvr pvm图片都是如此 (每次只读部分)


    已经做过压缩优化的游戏列表:


    Black Matrix AD——正邪幻想曲(80min完整版) 日版


    Biohazard_CV 维罗妮卡 汉化修改版 汉化版


    De La Jet Set Radio——街头涂鸦修改版 日版加强版


    Daytona USA 2001——梦游美国2001优化版 日版


    Eternal Arcadia——永恒的阿卡迪亚700m完整测试版 美版,日版


    Fushigi no Dungeon——风来西林700M完整版 日版


    IZUMO——出云战记(80min)完整版 日版


    KOF99修改版 日版


    NAPPLE _TALE——白日梦物语(完整版+rip版) 日版


    Spawn - In the Demon's Hand——再生侠汉化修改版 汉化版


    Vampire Chronicle for Matching Service——恶魔战士年代记700M完整版 日版









    以下为dc sd卡cf卡硬盘用镜像(可以自行下载做cdi镜像刻录)​



    LAST_BLADE2 月华剑士2修改版 日版​

    POWER_STONE2 能量宝石2修改版美版


    sega方块 日版​

    Marvel vs. Capcom 2 美版
    Street Fighter Zero 3 街霸ZERO3 日版

    Zombie Revenge 僵尸复仇修改版 美版
    Fighting Vipers 2 格斗之蛇2 日版
    Silent Scope 沉默的狙击手 日版
    Virtua Striker 2 VR射手2 美版
    Crazy Taxi 疯狂出租车 日版







    未发布/制作中:


    死或生2

    零式枪手

    娜可露露

    capcom vs Psikyo 麻将

    HARUSAME_YOUBI 春雨曜日

    HEAVY_METAL_GEOMATRIX重金属

    ORANGE_POCKET

    Roommate_Novel-Yuka_Sato

    Shutokou Battle 2 首都高2

    Trizeal

    Triggerheart Exelica

    VR战士3TB

    ................................



     
    Last edited: Jul 19, 2014
  2. -=FamilyGuy=-

    -=FamilyGuy=- Site Supporter 2049

    Joined:
    Mar 3, 2007
    Messages:
    3,033
    Likes Received:
    891
    YZB isn't a native english speaker and used google to translate this post from Chinese (i don't know which language exactly) to English, which didn't turn out too well (missing space etc.).

    He's a very talented Dreamcast hobbyist and programmer, I've been in contact with him on some occasions and I can resume what he said:

    He developed a technique akin to what echelon did on their infamous Sky of Arcadia release. Basically files are compressed on disc and decompressed on the fly as they are read via a small routine that hijack the normal reading one. Often, the process of reading a compressed file and decompressing it is even faster than reading the original file because of the reduced amount of data that has to be read on disc and the limitation on reading speed (12x ~ 1.7MB/s). He successfully modified a few titles to do this.
     
    Last edited: Jul 19, 2014
  3. yzb37859365

    yzb37859365 Spirited Member

    Joined:
    Jul 14, 2013
    Messages:
    187
    Likes Received:
    124
    yep~

    it's right~

    but maybe they have bug,need time test they...

    so ,If you encounter bug,please PM me~

    thank you FamilyGuy.
     
  4. TriMesh

    TriMesh Site Supporter 2013-2017

    Joined:
    Jul 3, 2008
    Messages:
    2,324
    Likes Received:
    750
    Interesting idea - but the linked site seems to be one of this Chinese BBSes that uses site coins to get access to the download links. Any chance of some links that are more accessible to non-Chinese speakers?
     
  5. yzb37859365

    yzb37859365 Spirited Member

    Joined:
    Jul 14, 2013
    Messages:
    187
    Likes Received:
    124
    Download address Links to most of them are Chinese website, http://www.theisozone.com only 2 (sorry in that I upload always unsuccessful), one is the Skies of Arcadia and Vampire Chronicle For Matching Service
    If you want to download any game, it is ok to reply to this post, I'll post, but they are all Chinese website download link.
     
    Last edited: Jul 20, 2014
  6. Gromber

    Gromber Spirited Member

    Joined:
    Apr 4, 2012
    Messages:
    115
    Likes Received:
    30
    a shenmue 2 full speech on a normal cd? :p
     
  7. yzb37859365

    yzb37859365 Spirited Member

    Joined:
    Jul 14, 2013
    Messages:
    187
    Likes Received:
    124
    shenmue 1 and 2 use gzip
    Many files compressed (gz), only a small amount of no, and voice of the game a lot, these are not compressed
     
  8. -=FamilyGuy=-

    -=FamilyGuy=- Site Supporter 2049

    Joined:
    Mar 3, 2007
    Messages:
    3,033
    Likes Received:
    891
    I already made that, but the voices are gruff. You meant full-quality I guess? The problem is that most audio codec are already good compressors so compressing them further doesn't really help. Try zipping a mp3, you'll not gain much space if at all.
     
  9. Superrayman3

    Superrayman3 Peppy Member

    Joined:
    Sep 24, 2011
    Messages:
    315
    Likes Received:
    21
    FamilyGuy is pretty spot on about the audio compression but wouldn't it be possible to compress some of the other game assets like graphics and stuff, or would that be impossible in Shenmue II's case?
     
  10. -=FamilyGuy=-

    -=FamilyGuy=- Site Supporter 2049

    Joined:
    Mar 3, 2007
    Messages:
    3,033
    Likes Received:
    891
    Some Shenmue files could be compressed, but a few really. Most of the space is taken by audio, like, the vast majority and a lot of the other files are also already compressed in gzip format which wouldn't benefit from further compression. Though in my releases I've extracted and recompressed them using 7z to save a few kB.
     
    Last edited: Jul 21, 2014
  11. PrOfUnD Darkness

    PrOfUnD Darkness Familiar Face

    Joined:
    Mar 13, 2004
    Messages:
    1,121
    Likes Received:
    48
    That's very interesting. How does he hijack the original loading routing?
     
  12. -=FamilyGuy=-

    -=FamilyGuy=- Site Supporter 2049

    Joined:
    Mar 3, 2007
    Messages:
    3,033
    Likes Received:
    891
    I can't say for sure, as I don't have the details myself, but the general idea in this kind of procedure is to find the routine in the bootbin (kinda hard). Then you gotta write a routine in ASM that does your own stuff so to get a binary blob that can be placed in the bootbin. Then the idea is to find the Jump to SubRoutine (JSR) call that points to the original routine and direct it to your own one, probably appended to the binary or put over the old one if there's room. You could also edit the original routine to jump to yours right away or what not, as long as the effect is the same. Note that the new routine could be implemented in the bootsector (ip.bin) as I believe it's loaded in memory at boot, just like with saturn, but I'm not sure.

    Geist Force was fixed this way; IIRC instead of using standard Katana libraries, it implemented reading to disc in mode1 blindly, but backups are writte in mode2 form1. The original routine was modified.
     
    Last edited: Jul 22, 2014
  13. yzb37859365

    yzb37859365 Spirited Member

    Joined:
    Jul 14, 2013
    Messages:
    187
    Likes Received:
    124
    Decompression procedure requires only 0x220 bytes, which are usually in the 1st file and some spare space
    If not, put the other spare memory address translation is finished sggg font and text into a new address...
     
  14. PrOfUnD Darkness

    PrOfUnD Darkness Familiar Face

    Joined:
    Mar 13, 2004
    Messages:
    1,121
    Likes Received:
    48
    Amazing, I just love to read about that technical challenges. It would be nice to create a knowledge base (wiki of kind) about that kind of stuff somewhere. Congrats for the OP!

    Geist Force is a weird beast, I wonder what SDK did SEGA use to develope it.
     
  15. fathertime

    fathertime Rapidly Rising Member

    Joined:
    Jul 14, 2011
    Messages:
    82
    Likes Received:
    0
    Did the developer of the echelon release ever talk about what they did on forums etc or is that all underground? The developer was obviously very talented and I'm sure has some interesting stories to share from that time period.
     
  16. -=FamilyGuy=-

    -=FamilyGuy=- Site Supporter 2049

    Joined:
    Mar 3, 2007
    Messages:
    3,033
    Likes Received:
    891
    Never heard of such, but would like to as well. Those people were very secretive back then, it was plain piracy of current-gen video-games at that time so not many infos leaked out.
     
  17. yzb37859365

    yzb37859365 Spirited Member

    Joined:
    Jul 14, 2013
    Messages:
    187
    Likes Received:
    124
    2015.02.24
    new rip game msr(80min full).....

    Metropolis Street Racer (US) (Sega of America) (2000) [MK-51012] [01-0086-51012-6]
    Revision description:
    1 downsampled msr.sfd (thanks -=FamilyGuy=- help me make)

    2 compression part of the file read, optimization

    3 everything open

    down:
    https://mega.co.nz/#!HR9j3K4I!zjTsDLYGL5jpp6sx5z3IdcH4w-TDm6q0QbOOFm4hx94


    thanks
    -=FamilyGuy=-

    Welcome to test....
     
    Last edited: Apr 13, 2015
  18. yzb37859365

    yzb37859365 Spirited Member

    Joined:
    Jul 14, 2013
    Messages:
    187
    Likes Received:
    124
    add:
    kof2k
    kof2k1
    Bakumatsu Roman Daini Maku - Gekka no Kenshi - Final Edition (JP)
    Garou - Mark of the Wolves (JP)
    Tricolore Crise
    ATELIER_MARIE_AND_ELIE(80min full)

    If anyone wants to reply it......
     
  19. horowitz

    horowitz Newly Registered

    Joined:
    Apr 16, 2016
    Messages:
    1
    Likes Received:
    0
    YZB, Could you make available your 80 min rip of maken x dreamcast cdi Japanese version? I believe it is the one on this post:http://bbs.chinaemu.org/read.php?fid=92&tid=96480&u=
    It is just that i cannot seem to be able to download it there. Would be very grateful if you could help me with this one. Been looking for a working cdi of this game for awhile now...
     
sonicdude10
Draft saved Draft deleted
Insert every image as a...
  1.  0%

Share This Page