hashcat Forum

10x 7970, 4x 5970, 3x 6990, and a 5870. 4x SDR Infiniband interconnect. catalyst 12.8, vcl 1.15, vclHashcat-lite v0.11-rc1

Impressive numbers, interesting what would they be on GB lan, not infiniband.

They are lower on GigE -- not due to bandwidth, but due to latency. Ethernet latencies are too high.

(12-02-2012, 06:54 PM)epixoip Wrote: [ -> ]10x 7970, 4x 5970, 3x 6990, and a 5870. 4x SDR Infiniband interconnect.

10x 7970 Wow ! :0

As I am a proud owner of a single HD5870, I like to think the inclusion of 1 x HD5870 made all the difference to your results

Ha ha !

The 5870 totally pushed it over the edge

wow thats awesome! i tried to get vcl working but i fail at linux and gave up. followed atom's wiki but keep getting "libOpenCL.so cannot be found" on the master.

Very impressive numbers! So vclhashcat-lite v0.11 will support mixed-GPUs.

Any idea when this will be released for the public?

(12-02-2012, 06:54 PM)epixoip Wrote: [ -> ]10x 7970, 4x 5970, 3x 6990, and a 5870. 4x SDR Infiniband interconnect. catalyst 12.8, vcl 1.15, vclHashcat-lite v0.11-rc1

Code:

epixoip@token:~/oclHashcat-lite-0.11$ LD_LIBRARY_PATH=/usr/lib/vcl vclrun ./vclHashcat-lite64.bin -b --benchmark-mode 1 --force
oclHashcat-lite v0.11 by atom starting...

Password lengths: 1 - 54
Watchdog: Temperature abort trigger disabled
Watchdog: Temperature retain trigger disabled
Device #1: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #2: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #3: Cypress, 512MB, 830Mhz, 20MCU
Device #4: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #5: Cypress, 512MB, 830Mhz, 20MCU
Device #6: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #7: Cypress, 512MB, 830Mhz, 20MCU
Device #8: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #9: Cypress, 512MB, 830Mhz, 20MCU
Device #10: Cayman, 1024MB, 880Mhz, 24MCU
Device #11: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #12: Cypress, 512MB, 830Mhz, 20MCU
Device #13: Cayman, 1024MB, 880Mhz, 24MCU
Device #14: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #15: Cypress, 512MB, 830Mhz, 20MCU
Device #16: Cayman, 1024MB, 880Mhz, 24MCU
Device #17: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #18: Cypress, 512MB, 830Mhz, 20MCU
Device #19: Cayman, 1024MB, 880Mhz, 24MCU
Device #20: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #21: Cypress, 512MB, 830Mhz, 20MCU
Device #22: Cayman, 1024MB, 880Mhz, 24MCU
Device #23: Tahiti, 2048MB, 1100Mhz, 32MCU
Device #24: Cypress, 512MB, 830Mhz, 20MCU
Device #25: Cayman, 1024MB, 880Mhz, 24MCU

[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: MD5
Speed.GPU.#1.:  9593.3M/s
Speed.GPU.#2.:  9595.6M/s
Speed.GPU.#3.:  5565.1M/s
Speed.GPU.#4.:  9577.7M/s
Speed.GPU.#5.:  5569.4M/s
Speed.GPU.#6.:  9591.6M/s
Speed.GPU.#7.:  5568.7M/s
Speed.GPU.#8.:  9577.6M/s
Speed.GPU.#9.:  5564.6M/s
Speed.GPU.#10.:  5668.3M/s
Speed.GPU.#11.:  9589.5M/s
Speed.GPU.#12.:  5900.0M/s
Speed.GPU.#13.:  5670.6M/s
Speed.GPU.#14.:  9569.5M/s
Speed.GPU.#15.:  5546.8M/s
Speed.GPU.#16.:  5668.6M/s
Speed.GPU.#17.:  9469.2M/s
Speed.GPU.#18.:  5548.9M/s
Speed.GPU.#19.:  5666.1M/s
Speed.GPU.#20.:  9485.5M/s
Speed.GPU.#21.:  5547.9M/s
Speed.GPU.#22.:  5670.2M/s
Speed.GPU.#23.:  9493.5M/s
Speed.GPU.#24.:  5545.0M/s
Speed.GPU.#25.:  5668.8M/s
Speed.GPU.#*.:   179.9G/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: md5($pass.$salt)
Speed.GPU.#1.:  9585.7M/s
Speed.GPU.#2.:  9602.7M/s
Speed.GPU.#3.:  5555.4M/s
Speed.GPU.#4.:  9571.7M/s
Speed.GPU.#5.:  5548.5M/s
Speed.GPU.#6.:  9602.1M/s
Speed.GPU.#7.:  5545.1M/s
Speed.GPU.#8.:  9561.4M/s
Speed.GPU.#9.:  5545.5M/s
Speed.GPU.#10.:  5668.1M/s
Speed.GPU.#11.:  9562.3M/s
Speed.GPU.#12.:  5893.3M/s
Speed.GPU.#13.:  5664.2M/s
Speed.GPU.#14.:  9598.6M/s
Speed.GPU.#15.:  5523.8M/s
Speed.GPU.#16.:  5663.2M/s
Speed.GPU.#17.:  9459.2M/s
Speed.GPU.#18.:  5537.0M/s
Speed.GPU.#19.:  5665.0M/s
Speed.GPU.#20.:  9458.0M/s
Speed.GPU.#21.:  5548.5M/s
Speed.GPU.#22.:  5663.9M/s
Speed.GPU.#23.:  9466.4M/s
Speed.GPU.#24.:  5528.9M/s
Speed.GPU.#25.:  5666.6M/s
Speed.GPU.#*.:   179.7G/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: Joomla
Speed.GPU.#1.:  9584.5M/s
Speed.GPU.#2.:  9587.8M/s
Speed.GPU.#3.:  5546.6M/s
Speed.GPU.#4.:  9571.9M/s
Speed.GPU.#5.:  5558.9M/s
Speed.GPU.#6.:  9578.7M/s
Speed.GPU.#7.:  5547.1M/s
Speed.GPU.#8.:  9596.0M/s
Speed.GPU.#9.:  5543.5M/s
Speed.GPU.#10.:  5660.8M/s
Speed.GPU.#11.:  9593.0M/s
Speed.GPU.#12.:  5890.1M/s
Speed.GPU.#13.:  5667.2M/s
Speed.GPU.#14.:  9593.1M/s
Speed.GPU.#15.:  5519.8M/s
Speed.GPU.#16.:  5666.2M/s
Speed.GPU.#17.:  9510.3M/s
Speed.GPU.#18.:  5532.6M/s
Speed.GPU.#19.:  5662.1M/s
Speed.GPU.#20.:  9504.3M/s
Speed.GPU.#21.:  5539.4M/s
Speed.GPU.#22.:  5666.0M/s
Speed.GPU.#23.:  9497.4M/s
Speed.GPU.#24.:  5527.4M/s
Speed.GPU.#25.:  5663.3M/s
Speed.GPU.#*.:   179.8G/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: SHA1
Speed.GPU.#1.:  3373.3M/s
Speed.GPU.#2.:  3367.7M/s
Speed.GPU.#3.:  1945.9M/s
Speed.GPU.#4.:  3364.4M/s
Speed.GPU.#5.:  1945.7M/s
Speed.GPU.#6.:  3367.9M/s
Speed.GPU.#7.:  1947.0M/s
Speed.GPU.#8.:  3370.9M/s
Speed.GPU.#9.:  1946.7M/s
Speed.GPU.#10.:  1958.5M/s
Speed.GPU.#11.:  3366.8M/s
Speed.GPU.#12.:  2062.6M/s
Speed.GPU.#13.:  1958.3M/s
Speed.GPU.#14.:  3370.2M/s
Speed.GPU.#15.:  1944.9M/s
Speed.GPU.#16.:  1957.3M/s
Speed.GPU.#17.:  3362.9M/s
Speed.GPU.#18.:  1945.2M/s
Speed.GPU.#19.:  1957.5M/s
Speed.GPU.#20.:  3362.4M/s
Speed.GPU.#21.:  1945.1M/s
Speed.GPU.#22.:  1958.0M/s
Speed.GPU.#23.:  3359.5M/s
Speed.GPU.#24.:  1943.4M/s
Speed.GPU.#25.:  1958.8M/s
Speed.GPU.#*.: 63040.9M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: SHA-1(Base64), nsldap, Netscape LDAP SHA
Speed.GPU.#1.:  3372.7M/s
Speed.GPU.#2.:  3367.0M/s
Speed.GPU.#3.:  1946.9M/s
Speed.GPU.#4.:  3370.7M/s
Speed.GPU.#5.:  1941.9M/s
Speed.GPU.#6.:  3368.0M/s
Speed.GPU.#7.:  1946.7M/s
Speed.GPU.#8.:  3367.7M/s
Speed.GPU.#9.:  1947.2M/s
Speed.GPU.#10.:  1957.1M/s
Speed.GPU.#11.:  3368.9M/s
Speed.GPU.#12.:  2064.0M/s
Speed.GPU.#13.:  1956.6M/s
Speed.GPU.#14.:  3368.7M/s
Speed.GPU.#15.:  1943.3M/s
Speed.GPU.#16.:  1958.3M/s
Speed.GPU.#17.:  3363.9M/s
Speed.GPU.#18.:  1943.1M/s
Speed.GPU.#19.:  1957.5M/s
Speed.GPU.#20.:  3363.9M/s
Speed.GPU.#21.:  1943.6M/s
Speed.GPU.#22.:  1958.2M/s
Speed.GPU.#23.:  3360.3M/s
Speed.GPU.#24.:  1944.4M/s
Speed.GPU.#25.:  1958.5M/s
Speed.GPU.#*.: 63039.2M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: sha1($pass.$salt)
Speed.GPU.#1.:  3372.4M/s
Speed.GPU.#2.:  3366.7M/s
Speed.GPU.#3.:  1945.5M/s
Speed.GPU.#4.:  3365.3M/s
Speed.GPU.#5.:  1945.7M/s
Speed.GPU.#6.:  3365.7M/s
Speed.GPU.#7.:  1946.3M/s
Speed.GPU.#8.:  3370.3M/s
Speed.GPU.#9.:  1947.1M/s
Speed.GPU.#10.:  1958.4M/s
Speed.GPU.#11.:  3370.9M/s
Speed.GPU.#12.:  2063.1M/s
Speed.GPU.#13.:  1958.0M/s
Speed.GPU.#14.:  3366.2M/s
Speed.GPU.#15.:  1943.8M/s
Speed.GPU.#16.:  1958.8M/s
Speed.GPU.#17.:  3367.3M/s
Speed.GPU.#18.:  1944.7M/s
Speed.GPU.#19.:  1958.6M/s
Speed.GPU.#20.:  3366.3M/s
Speed.GPU.#21.:  1942.1M/s
Speed.GPU.#22.:  1958.9M/s
Speed.GPU.#23.:  3362.6M/s
Speed.GPU.#24.:  1944.7M/s
Speed.GPU.#25.:  1959.5M/s
Speed.GPU.#*.: 63048.9M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: SSHA-1(Base64), nsldaps, Netscape LDAP SSHA
Speed.GPU.#1.:  3374.1M/s
Speed.GPU.#2.:  3373.0M/s
Speed.GPU.#3.:  1944.7M/s
Speed.GPU.#4.:  3372.0M/s
Speed.GPU.#5.:  1945.1M/s
Speed.GPU.#6.:  3372.6M/s
Speed.GPU.#7.:  1946.0M/s
Speed.GPU.#8.:  3368.3M/s
Speed.GPU.#9.:  1946.0M/s
Speed.GPU.#10.:  1956.4M/s
Speed.GPU.#11.:  3369.1M/s
Speed.GPU.#12.:  2063.9M/s
Speed.GPU.#13.:  1957.8M/s
Speed.GPU.#14.:  3370.6M/s
Speed.GPU.#15.:  1945.1M/s
Speed.GPU.#16.:  1957.3M/s
Speed.GPU.#17.:  3363.3M/s
Speed.GPU.#18.:  1944.9M/s
Speed.GPU.#19.:  1958.6M/s
Speed.GPU.#20.:  3362.8M/s
Speed.GPU.#21.:  1944.3M/s
Speed.GPU.#22.:  1958.1M/s
Speed.GPU.#23.:  3360.9M/s
Speed.GPU.#24.:  1945.0M/s
Speed.GPU.#25.:  1958.6M/s
Speed.GPU.#*.: 63058.6M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: Oracle 11g
Speed.GPU.#1.:  3367.7M/s
Speed.GPU.#2.:  3370.3M/s
Speed.GPU.#3.:  1945.8M/s
Speed.GPU.#4.:  3369.2M/s
Speed.GPU.#5.:  1947.2M/s
Speed.GPU.#6.:  3371.7M/s
Speed.GPU.#7.:  1947.3M/s
Speed.GPU.#8.:  3368.5M/s
Speed.GPU.#9.:  1946.9M/s
Speed.GPU.#10.:  1957.6M/s
Speed.GPU.#11.:  3373.0M/s
Speed.GPU.#12.:  2062.1M/s
Speed.GPU.#13.:  1957.7M/s
Speed.GPU.#14.:  3373.5M/s
Speed.GPU.#15.:  1946.4M/s
Speed.GPU.#16.:  1957.1M/s
Speed.GPU.#17.:  3367.2M/s
Speed.GPU.#18.:  1947.0M/s
Speed.GPU.#19.:  1958.4M/s
Speed.GPU.#20.:  3368.3M/s
Speed.GPU.#21.:  1946.5M/s
Speed.GPU.#22.:  1957.8M/s
Speed.GPU.#23.:  3361.7M/s
Speed.GPU.#24.:  1946.3M/s
Speed.GPU.#25.:  1958.4M/s
Speed.GPU.#*.: 63073.6M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: MSSQL(2000)
Speed.GPU.#1.:  3342.6M/s
Speed.GPU.#2.:  3342.2M/s
Speed.GPU.#3.:  1938.5M/s
Speed.GPU.#4.:  3341.3M/s
Speed.GPU.#5.:  1938.5M/s
Speed.GPU.#6.:  3349.6M/s
Speed.GPU.#7.:  1938.5M/s
Speed.GPU.#8.:  3344.9M/s
Speed.GPU.#9.:  1938.1M/s
Speed.GPU.#10.:  1936.1M/s
Speed.GPU.#11.:  3345.0M/s
Speed.GPU.#12.:  2052.8M/s
Speed.GPU.#13.:  1935.9M/s
Speed.GPU.#14.:  3346.8M/s
Speed.GPU.#15.:  1937.7M/s
Speed.GPU.#16.:  1935.8M/s
Speed.GPU.#17.:  3340.7M/s
Speed.GPU.#18.:  1937.3M/s
Speed.GPU.#19.:  1934.6M/s
Speed.GPU.#20.:  3340.4M/s
Speed.GPU.#21.:  1937.7M/s
Speed.GPU.#22.:  1935.7M/s
Speed.GPU.#23.:  3334.8M/s
Speed.GPU.#24.:  1938.1M/s
Speed.GPU.#25.:  1929.6M/s
Speed.GPU.#*.: 62593.1M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: MSSQL(2005)
Speed.GPU.#1.:  3355.3M/s
Speed.GPU.#2.:  3355.0M/s
Speed.GPU.#3.:  1941.9M/s
Speed.GPU.#4.:  3355.3M/s
Speed.GPU.#5.:  1940.6M/s
Speed.GPU.#6.:  3352.7M/s
Speed.GPU.#7.:  1940.7M/s
Speed.GPU.#8.:  3351.5M/s
Speed.GPU.#9.:  1940.9M/s
Speed.GPU.#10.:  1937.2M/s
Speed.GPU.#11.:  3356.9M/s
Speed.GPU.#12.:  2056.8M/s
Speed.GPU.#13.:  1940.0M/s
Speed.GPU.#14.:  3356.9M/s
Speed.GPU.#15.:  1940.8M/s
Speed.GPU.#16.:  1925.6M/s
Speed.GPU.#17.:  3345.0M/s
Speed.GPU.#18.:  1939.7M/s
Speed.GPU.#19.:  1937.9M/s
Speed.GPU.#20.:  3348.9M/s
Speed.GPU.#21.:  1940.9M/s
Speed.GPU.#22.:  1937.4M/s
Speed.GPU.#23.:  3348.4M/s
Speed.GPU.#24.:  1939.8M/s
Speed.GPU.#25.:  1939.0M/s
Speed.GPU.#*.: 62725.0M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: MySQL
Speed.GPU.#1.:  1494.6M/s
Speed.GPU.#2.:  1493.9M/s
Speed.GPU.#3.:   479.8M/s
Speed.GPU.#4.:  1494.3M/s
Speed.GPU.#5.:   480.4M/s
Speed.GPU.#6.:  1494.1M/s
Speed.GPU.#7.:   479.6M/s
Speed.GPU.#8.:  1494.3M/s
Speed.GPU.#9.:   479.4M/s
Speed.GPU.#10.:   687.0M/s
Speed.GPU.#11.:  1494.3M/s
Speed.GPU.#12.:   499.6M/s
Speed.GPU.#13.:   686.1M/s
Speed.GPU.#14.:  1494.6M/s
Speed.GPU.#15.:   479.8M/s
Speed.GPU.#16.:   683.5M/s
Speed.GPU.#17.:  1494.3M/s
Speed.GPU.#18.:   479.8M/s
Speed.GPU.#19.:   680.8M/s
Speed.GPU.#20.:  1494.6M/s
Speed.GPU.#21.:   479.6M/s
Speed.GPU.#22.:   685.3M/s
Speed.GPU.#23.:  1494.1M/s
Speed.GPU.#24.:   480.0M/s
Speed.GPU.#25.:   679.5M/s
Speed.GPU.#*.: 23383.1M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: MD4
Speed.GPU.#1.: 18927.0M/s
Speed.GPU.#2.: 19012.1M/s
Speed.GPU.#3.:  9781.0M/s
Speed.GPU.#4.: 18915.8M/s
Speed.GPU.#5.:  9806.7M/s
Speed.GPU.#6.: 19040.1M/s
Speed.GPU.#7.:  9804.1M/s
Speed.GPU.#8.: 18946.8M/s
Speed.GPU.#9.:  9843.0M/s
Speed.GPU.#10.: 10781.7M/s
Speed.GPU.#11.: 19035.9M/s
Speed.GPU.#12.: 10437.0M/s
Speed.GPU.#13.: 10752.4M/s
Speed.GPU.#14.: 18985.0M/s
Speed.GPU.#15.:  9751.1M/s
Speed.GPU.#16.: 10805.2M/s
Speed.GPU.#17.: 18457.9M/s
Speed.GPU.#18.:  9750.0M/s
Speed.GPU.#19.: 10778.2M/s
Speed.GPU.#20.: 18511.4M/s
Speed.GPU.#21.:  9745.9M/s
Speed.GPU.#22.: 10794.6M/s
Speed.GPU.#23.: 18429.4M/s
Speed.GPU.#24.:  9740.8M/s
Speed.GPU.#25.: 10789.9M/s
Speed.GPU.#*.:   341.6G/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: md4($pass.$salt)
Speed.GPU.#1.: 18937.3M/s
Speed.GPU.#2.: 19001.0M/s
Speed.GPU.#3.:  9879.9M/s
Speed.GPU.#4.: 19052.1M/s
Speed.GPU.#5.:  9877.9M/s
Speed.GPU.#6.: 19005.9M/s
Speed.GPU.#7.:  9886.7M/s
Speed.GPU.#8.: 18977.5M/s
Speed.GPU.#9.:  9894.7M/s
Speed.GPU.#10.: 10790.3M/s
Speed.GPU.#11.: 18950.9M/s
Speed.GPU.#12.: 10458.1M/s
Speed.GPU.#13.: 10802.6M/s
Speed.GPU.#14.: 18998.3M/s
Speed.GPU.#15.:  9840.5M/s
Speed.GPU.#16.: 10752.8M/s
Speed.GPU.#17.: 18497.2M/s
Speed.GPU.#18.:  9770.8M/s
Speed.GPU.#19.: 10765.3M/s
Speed.GPU.#20.: 18603.5M/s
Speed.GPU.#21.:  9726.1M/s
Speed.GPU.#22.: 10821.4M/s
Speed.GPU.#23.: 18472.9M/s
Speed.GPU.#24.:  9837.7M/s
Speed.GPU.#25.: 10745.3M/s
Speed.GPU.#*.:   342.3G/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: NTLM
Speed.GPU.#1.: 18334.2M/s
Speed.GPU.#2.: 18280.8M/s
Speed.GPU.#3.:  9649.7M/s
Speed.GPU.#4.: 18345.4M/s
Speed.GPU.#5.:  9650.9M/s
Speed.GPU.#6.: 18251.7M/s
Speed.GPU.#7.:  9664.1M/s
Speed.GPU.#8.: 18354.1M/s
Speed.GPU.#9.:  9676.0M/s
Speed.GPU.#10.: 10612.2M/s
Speed.GPU.#11.: 18253.6M/s
Speed.GPU.#12.: 10229.6M/s
Speed.GPU.#13.: 10649.0M/s
Speed.GPU.#14.: 18290.7M/s
Speed.GPU.#15.:  9608.7M/s
Speed.GPU.#16.: 10645.5M/s
Speed.GPU.#17.: 17930.6M/s
Speed.GPU.#18.:  9643.8M/s
Speed.GPU.#19.: 10665.0M/s
Speed.GPU.#20.: 17918.7M/s
Speed.GPU.#21.:  9616.0M/s
Speed.GPU.#22.: 10639.6M/s
Speed.GPU.#23.: 17877.9M/s
Speed.GPU.#24.:  9585.4M/s
Speed.GPU.#25.: 10617.4M/s
Speed.GPU.#*.:   333.0G/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: DCC, mscash
Speed.GPU.#1.:  5041.6M/s
Speed.GPU.#2.:  5047.1M/s
Speed.GPU.#3.:  2919.9M/s
Speed.GPU.#4.:  5047.4M/s
Speed.GPU.#5.:  2920.2M/s
Speed.GPU.#6.:  5047.3M/s
Speed.GPU.#7.:  2919.3M/s
Speed.GPU.#8.:  5048.3M/s
Speed.GPU.#9.:  2919.3M/s
Speed.GPU.#10.:  3009.3M/s
Speed.GPU.#11.:  5054.4M/s
Speed.GPU.#12.:  3091.9M/s
Speed.GPU.#13.:  3011.1M/s
Speed.GPU.#14.:  5050.8M/s
Speed.GPU.#15.:  2910.7M/s
Speed.GPU.#16.:  3009.6M/s
Speed.GPU.#17.:  5018.7M/s
Speed.GPU.#18.:  2911.2M/s
Speed.GPU.#19.:  3009.0M/s
Speed.GPU.#20.:  5019.1M/s
Speed.GPU.#21.:  2910.0M/s
Speed.GPU.#22.:  3008.9M/s
Speed.GPU.#23.:  5012.4M/s
Speed.GPU.#24.:  2911.5M/s
Speed.GPU.#25.:  3007.5M/s
Speed.GPU.#*.: 94856.3M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: SHA256
Speed.GPU.#1.:  1206.8M/s
Speed.GPU.#2.:  1210.3M/s
Speed.GPU.#3.:   589.6M/s
Speed.GPU.#4.:  1208.2M/s
Speed.GPU.#5.:   586.6M/s
Speed.GPU.#6.:  1216.7M/s
Speed.GPU.#7.:   588.2M/s
Speed.GPU.#8.:  1209.0M/s
Speed.GPU.#9.:   587.8M/s
Speed.GPU.#10.:   684.6M/s
Speed.GPU.#11.:  1214.9M/s
Speed.GPU.#12.:   620.7M/s
Speed.GPU.#13.:   694.0M/s
Speed.GPU.#14.:  1215.9M/s
Speed.GPU.#15.:   584.8M/s
Speed.GPU.#16.:   701.1M/s
Speed.GPU.#17.:  1160.8M/s
Speed.GPU.#18.:   577.1M/s
Speed.GPU.#19.:   703.0M/s
Speed.GPU.#20.:  1161.6M/s
Speed.GPU.#21.:   578.8M/s
Speed.GPU.#22.:   698.7M/s
Speed.GPU.#23.:  1166.6M/s
Speed.GPU.#24.:   578.1M/s
Speed.GPU.#25.:   694.2M/s
Speed.GPU.#*.: 21438.4M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: sha256($pass.$salt)
Speed.GPU.#1.:  1210.9M/s
Speed.GPU.#2.:  1206.0M/s
Speed.GPU.#3.:   586.9M/s
Speed.GPU.#4.:  1211.0M/s
Speed.GPU.#5.:   584.0M/s
Speed.GPU.#6.:  1217.9M/s
Speed.GPU.#7.:   586.5M/s
Speed.GPU.#8.:  1200.7M/s
Speed.GPU.#9.:   585.8M/s
Speed.GPU.#10.:   700.3M/s
Speed.GPU.#11.:  1211.7M/s
Speed.GPU.#12.:   618.9M/s
Speed.GPU.#13.:   699.4M/s
Speed.GPU.#14.:  1218.7M/s
Speed.GPU.#15.:   581.0M/s
Speed.GPU.#16.:   698.9M/s
Speed.GPU.#17.:  1157.0M/s
Speed.GPU.#18.:   579.7M/s
Speed.GPU.#19.:   701.3M/s
Speed.GPU.#20.:  1159.3M/s
Speed.GPU.#21.:   583.4M/s
Speed.GPU.#22.:   696.8M/s
Speed.GPU.#23.:  1153.9M/s
Speed.GPU.#24.:   579.7M/s
Speed.GPU.#25.:   695.0M/s
Speed.GPU.#*.: 21424.6M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: descrypt, DES(Unix), Traditional DES
Speed.GPU.#1.: 96840.6k/s
Speed.GPU.#2.: 96781.8k/s
Speed.GPU.#3.: 32583.9k/s
Speed.GPU.#4.: 96765.3k/s
Speed.GPU.#5.: 32599.2k/s
Speed.GPU.#6.: 96822.2k/s
Speed.GPU.#7.: 32593.9k/s
Speed.GPU.#8.: 96780.3k/s
Speed.GPU.#9.: 32598.7k/s
Speed.GPU.#10.: 42166.8k/s
Speed.GPU.#11.: 96801.4k/s
Speed.GPU.#12.: 34560.1k/s
Speed.GPU.#13.: 42175.5k/s
Speed.GPU.#14.: 96934.1k/s
Speed.GPU.#15.: 32575.1k/s
Speed.GPU.#16.: 42182.0k/s
Speed.GPU.#17.: 96834.8k/s
Speed.GPU.#18.: 32580.1k/s
Speed.GPU.#19.: 42191.9k/s
Speed.GPU.#20.: 96833.9k/s
Speed.GPU.#21.: 32587.6k/s
Speed.GPU.#22.: 42191.3k/s
Speed.GPU.#23.: 96848.8k/s
Speed.GPU.#24.: 32574.9k/s
Speed.GPU.#25.: 42209.0k/s
Speed.GPU.#*.:  1516.6M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: SHA512
Speed.GPU.#1.: 97034.7k/s
Speed.GPU.#2.: 96979.7k/s
Speed.GPU.#3.: 56830.4k/s
Speed.GPU.#4.: 96955.2k/s
Speed.GPU.#5.: 56894.6k/s
Speed.GPU.#6.: 97054.2k/s
Speed.GPU.#7.: 56797.0k/s
Speed.GPU.#8.: 97039.9k/s
Speed.GPU.#9.: 57711.3k/s
Speed.GPU.#10.:   113.8M/s
Speed.GPU.#11.: 97038.2k/s
Speed.GPU.#12.: 60066.2k/s
Speed.GPU.#13.:   117.3M/s
Speed.GPU.#14.: 97059.2k/s
Speed.GPU.#15.: 57559.4k/s
Speed.GPU.#16.:   117.3M/s
Speed.GPU.#17.: 96984.8k/s
Speed.GPU.#18.: 57609.8k/s
Speed.GPU.#19.:   117.2M/s
Speed.GPU.#20.: 96997.7k/s
Speed.GPU.#21.: 57631.1k/s
Speed.GPU.#22.:   117.2M/s
Speed.GPU.#23.: 96982.7k/s
Speed.GPU.#24.: 57648.4k/s
Speed.GPU.#25.:   117.3M/s
Speed.GPU.#*.:  2188.9M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: sha512($pass.$salt)
Speed.GPU.#1.: 97045.2k/s
Speed.GPU.#2.: 97000.0k/s
Speed.GPU.#3.: 57696.1k/s
Speed.GPU.#4.: 97048.7k/s
Speed.GPU.#5.: 57693.7k/s
Speed.GPU.#6.: 97051.5k/s
Speed.GPU.#7.: 57607.4k/s
Speed.GPU.#8.: 97037.1k/s
Speed.GPU.#9.: 57725.1k/s
Speed.GPU.#10.:   117.2M/s
Speed.GPU.#11.: 97138.5k/s
Speed.GPU.#12.: 60111.0k/s
Speed.GPU.#13.:   117.3M/s
Speed.GPU.#14.: 97027.4k/s
Speed.GPU.#15.: 57580.1k/s
Speed.GPU.#16.:   117.3M/s
Speed.GPU.#17.: 97030.9k/s
Speed.GPU.#18.: 57716.0k/s
Speed.GPU.#19.:   117.3M/s
Speed.GPU.#20.: 97031.4k/s
Speed.GPU.#21.: 57595.1k/s
Speed.GPU.#22.:   117.4M/s
Speed.GPU.#23.: 96970.8k/s
Speed.GPU.#24.: 57766.2k/s
Speed.GPU.#25.:   117.3M/s
Speed.GPU.#*.:  2195.6M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: SL3
Speed.GPU.#1.:  3353.4M/s
Speed.GPU.#2.:  3354.1M/s
Speed.GPU.#3.:  1943.8M/s
Speed.GPU.#4.:  3354.4M/s
Speed.GPU.#5.:  1944.2M/s
Speed.GPU.#6.:  3356.1M/s
Speed.GPU.#7.:  1944.3M/s
Speed.GPU.#8.:  3356.9M/s
Speed.GPU.#9.:  1944.1M/s
Speed.GPU.#10.:  1939.5M/s
Speed.GPU.#11.:  3352.5M/s
Speed.GPU.#12.:  2059.7M/s
Speed.GPU.#13.:  1928.2M/s
Speed.GPU.#14.:  3353.6M/s
Speed.GPU.#15.:  1941.7M/s
Speed.GPU.#16.:  1938.7M/s
Speed.GPU.#17.:  3346.8M/s
Speed.GPU.#18.:  1942.3M/s
Speed.GPU.#19.:  1932.1M/s
Speed.GPU.#20.:  3345.4M/s
Speed.GPU.#21.:  1941.8M/s
Speed.GPU.#22.:  1939.4M/s
Speed.GPU.#23.:  3345.4M/s
Speed.GPU.#24.:  1941.7M/s
Speed.GPU.#25.:  1941.1M/s
Speed.GPU.#*.: 62741.2M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: Cisco-PIX MD5
Speed.GPU.#1.:  6436.9M/s
Speed.GPU.#2.:  6430.8M/s
Speed.GPU.#3.:  3749.9M/s
Speed.GPU.#4.:  6418.6M/s
Speed.GPU.#5.:  3750.2M/s
Speed.GPU.#6.:  6423.8M/s
Speed.GPU.#7.:  3752.0M/s
Speed.GPU.#8.:  6418.6M/s
Speed.GPU.#9.:  3752.0M/s
Speed.GPU.#10.:  3810.0M/s
Speed.GPU.#11.:  6426.8M/s
Speed.GPU.#12.:  3970.2M/s
Speed.GPU.#13.:  3815.4M/s
Speed.GPU.#14.:  6420.0M/s
Speed.GPU.#15.:  3742.5M/s
Speed.GPU.#16.:  3813.8M/s
Speed.GPU.#17.:  6388.6M/s
Speed.GPU.#18.:  3743.2M/s
Speed.GPU.#19.:  3813.8M/s
Speed.GPU.#20.:  6392.9M/s
Speed.GPU.#21.:  3742.6M/s
Speed.GPU.#22.:  3813.5M/s
Speed.GPU.#23.:  6387.9M/s
Speed.GPU.#24.:  3726.5M/s
Speed.GPU.#25.:  3815.1M/s
Speed.GPU.#*.:   121.0G/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: Double MD5
Speed.GPU.#1.:  2741.1M/s
Speed.GPU.#2.:  2741.6M/s
Speed.GPU.#3.:  1365.8M/s
Speed.GPU.#4.:  2747.1M/s
Speed.GPU.#5.:  1366.1M/s
Speed.GPU.#6.:  2744.9M/s
Speed.GPU.#7.:  1366.0M/s
Speed.GPU.#8.:  2744.1M/s
Speed.GPU.#9.:  1366.0M/s
Speed.GPU.#10.:  1552.0M/s
Speed.GPU.#11.:  2743.7M/s
Speed.GPU.#12.:  1432.4M/s
Speed.GPU.#13.:  1552.4M/s
Speed.GPU.#14.:  2744.3M/s
Speed.GPU.#15.:  1364.9M/s
Speed.GPU.#16.:  1551.8M/s
Speed.GPU.#17.:  2744.1M/s
Speed.GPU.#18.:  1365.3M/s
Speed.GPU.#19.:  1552.1M/s
Speed.GPU.#20.:  2743.7M/s
Speed.GPU.#21.:  1365.3M/s
Speed.GPU.#22.:  1552.9M/s
Speed.GPU.#23.:  2744.7M/s
Speed.GPU.#24.:  1365.7M/s
Speed.GPU.#25.:  1551.8M/s
Speed.GPU.#*.: 49109.8M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: vBulletin < v3.8.5
Speed.GPU.#1.:  2746.9M/s
Speed.GPU.#2.:  2744.6M/s
Speed.GPU.#3.:  1365.7M/s
Speed.GPU.#4.:  2746.1M/s
Speed.GPU.#5.:  1365.7M/s
Speed.GPU.#6.:  2747.8M/s
Speed.GPU.#7.:  1366.2M/s
Speed.GPU.#8.:  2746.0M/s
Speed.GPU.#9.:  1365.8M/s
Speed.GPU.#10.:  1552.6M/s
Speed.GPU.#11.:  2746.6M/s
Speed.GPU.#12.:  1432.7M/s
Speed.GPU.#13.:  1553.1M/s
Speed.GPU.#14.:  2747.8M/s
Speed.GPU.#15.:  1365.0M/s
Speed.GPU.#16.:  1552.3M/s
Speed.GPU.#17.:  2743.7M/s
Speed.GPU.#18.:  1365.5M/s
Speed.GPU.#19.:  1553.1M/s
Speed.GPU.#20.:  2744.6M/s
Speed.GPU.#21.:  1366.0M/s
Speed.GPU.#22.:  1553.6M/s
Speed.GPU.#23.:  2740.7M/s
Speed.GPU.#24.:  1365.6M/s
Speed.GPU.#25.:  1553.2M/s
Speed.GPU.#*.: 49131.1M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: vBulletin > v3.8.5
Speed.GPU.#1.:  1874.8M/s
Speed.GPU.#2.:  1874.4M/s
Speed.GPU.#3.:  1046.8M/s
Speed.GPU.#4.:  1874.7M/s
Speed.GPU.#5.:  1046.4M/s
Speed.GPU.#6.:  1875.6M/s
Speed.GPU.#7.:  1046.2M/s
Speed.GPU.#8.:  1875.9M/s
Speed.GPU.#9.:  1046.4M/s
Speed.GPU.#10.:  1082.5M/s
Speed.GPU.#11.:  1875.0M/s
Speed.GPU.#12.:  1108.7M/s
Speed.GPU.#13.:  1082.9M/s
Speed.GPU.#14.:  1875.9M/s
Speed.GPU.#15.:  1046.1M/s
Speed.GPU.#16.:  1083.0M/s
Speed.GPU.#17.:  1875.2M/s
Speed.GPU.#18.:  1045.9M/s
Speed.GPU.#19.:  1083.3M/s
Speed.GPU.#20.:  1875.4M/s
Speed.GPU.#21.:  1046.3M/s
Speed.GPU.#22.:  1084.8M/s
Speed.GPU.#23.:  1875.7M/s
Speed.GPU.#24.:  1045.1M/s
Speed.GPU.#25.:  1084.3M/s
Speed.GPU.#*.: 34731.1M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: IPB2+, MyBB1.2+
Speed.GPU.#1.:  1919.0M/s
Speed.GPU.#2.:  1918.5M/s
Speed.GPU.#3.:  1091.4M/s
Speed.GPU.#4.:  1918.2M/s
Speed.GPU.#5.:  1092.0M/s
Speed.GPU.#6.:  1919.4M/s
Speed.GPU.#7.:  1091.5M/s
Speed.GPU.#8.:  1918.9M/s
Speed.GPU.#9.:  1091.6M/s
Speed.GPU.#10.:  1124.6M/s
Speed.GPU.#11.:  1920.2M/s
Speed.GPU.#12.:  1157.3M/s
Speed.GPU.#13.:  1124.8M/s
Speed.GPU.#14.:  1921.2M/s
Speed.GPU.#15.:  1091.5M/s
Speed.GPU.#16.:  1124.5M/s
Speed.GPU.#17.:  1920.1M/s
Speed.GPU.#18.:  1091.9M/s
Speed.GPU.#19.:  1124.7M/s
Speed.GPU.#20.:  1919.6M/s
Speed.GPU.#21.:  1092.3M/s
Speed.GPU.#22.:  1125.2M/s
Speed.GPU.#23.:  1918.5M/s
Speed.GPU.#24.:  1092.3M/s
Speed.GPU.#25.:  1125.1M/s
Speed.GPU.#*.: 35834.3M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: LM
Speed.GPU.#1.:  1441.2M/s
Speed.GPU.#2.:  1441.7M/s
Speed.GPU.#3.:   313.5M/s
Speed.GPU.#4.:  1443.3M/s
Speed.GPU.#5.:   313.8M/s
Speed.GPU.#6.:  1443.7M/s
Speed.GPU.#7.:   313.3M/s
Speed.GPU.#8.:  1442.9M/s
Speed.GPU.#9.:   313.5M/s
Speed.GPU.#10.:   523.9M/s
Speed.GPU.#11.:  1442.7M/s
Speed.GPU.#12.:   327.2M/s
Speed.GPU.#13.:   523.9M/s
Speed.GPU.#14.:  1443.5M/s
Speed.GPU.#15.:   311.5M/s
Speed.GPU.#16.:   523.9M/s
Speed.GPU.#17.:  1442.9M/s
Speed.GPU.#18.:   312.8M/s
Speed.GPU.#19.:   524.0M/s
Speed.GPU.#20.:  1443.0M/s
Speed.GPU.#21.:   312.3M/s
Speed.GPU.#22.:   524.1M/s
Speed.GPU.#23.:  1442.6M/s
Speed.GPU.#24.:   313.2M/s
Speed.GPU.#25.:   524.2M/s
Speed.GPU.#*.: 20402.7M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: Oracle 7-10g
Speed.GPU.#1.:   170.2M/s
Speed.GPU.#2.:   170.0M/s
Speed.GPU.#3.: 97575.9k/s
Speed.GPU.#4.:   170.1M/s
Speed.GPU.#5.: 97579.6k/s
Speed.GPU.#6.:   170.1M/s
Speed.GPU.#7.: 97658.2k/s
Speed.GPU.#8.:   170.2M/s
Speed.GPU.#9.: 97625.6k/s
Speed.GPU.#10.:   127.9M/s
Speed.GPU.#11.:   170.2M/s
Speed.GPU.#12.:   102.6M/s
Speed.GPU.#13.:   127.7M/s
Speed.GPU.#14.:   170.1M/s
Speed.GPU.#15.: 97210.5k/s
Speed.GPU.#16.:   128.1M/s
Speed.GPU.#17.:   168.5M/s
Speed.GPU.#18.: 97159.6k/s
Speed.GPU.#19.:   128.0M/s
Speed.GPU.#20.:   168.3M/s
Speed.GPU.#21.: 97203.8k/s
Speed.GPU.#22.:   127.9M/s
Speed.GPU.#23.:   168.4M/s
Speed.GPU.#24.: 97197.0k/s
Speed.GPU.#25.:   127.7M/s
Speed.GPU.#*.:  3345.1M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...


Hash.Type....: SHA-3(Keccak)
Speed.GPU.#1.: 85409.7k/s
Speed.GPU.#2.: 85416.8k/s
Speed.GPU.#3.: 73100.9k/s
Speed.GPU.#4.: 85462.5k/s
Speed.GPU.#5.: 73377.3k/s
Speed.GPU.#6.: 85361.0k/s
Speed.GPU.#7.: 72864.6k/s
Speed.GPU.#8.: 85437.6k/s
Speed.GPU.#9.: 73022.8k/s
Speed.GPU.#10.:   105.8M/s
Speed.GPU.#11.: 85460.7k/s
Speed.GPU.#12.: 77392.4k/s
Speed.GPU.#13.:   105.7M/s
Speed.GPU.#14.: 85456.5k/s
Speed.GPU.#15.: 72965.9k/s
Speed.GPU.#16.:   105.8M/s
Speed.GPU.#17.: 85408.4k/s
Speed.GPU.#18.: 72946.1k/s
Speed.GPU.#19.:   105.7M/s
Speed.GPU.#20.: 85424.0k/s
Speed.GPU.#21.: 73184.1k/s
Speed.GPU.#22.:   105.8M/s
Speed.GPU.#23.: 85350.3k/s
Speed.GPU.#24.: 73033.3k/s
Speed.GPU.#25.:   105.8M/s
Speed.GPU.#*.:  2150.7M/s
[s]tatus [p]ause [r]esume [q]uit =>
NOTE: Runtime limit reached, aborting...
dd
Started: Thu Nov 29 19:45:08 2012
Stopped: Thu Nov 29 19:57:36 2012

What a very interesting post. I can see from various form posts that some have attempted the following with little success. Before I attempt this revelation can you elobarate on the configuration details; and provide and estimate on the total network configuration (No GPU system pricing required)

What brand/model of Infinibad HBA adapter is used within each system?(X4 SDR interconnect)
What brand/model of Infinibad switch did you acquire?
What type of cabling is used from each adapter to the switch?(Fibre or cx-4 attached copper)
What version of Linux/Ubuntu did you test with?(12.04 or 12.04.1x64) Was ther native supprot for adapter drivers?
Was there any draw-baks interms of speeds based on the infiband x4 SDR technology that you used vs. x4ddr/x4qdr?

Thanx

(12-03-2012, 10:14 PM)jnet Wrote: [ -> ]Very impressive numbers! So vclhashcat-lite v0.11 will support mixed-GPUs.

Any idea when this will be released for the public?

current version of lite already supports mixed gpus. next version of plus supports mixed gpus, and should be released this month.

(12-03-2012, 11:35 PM)tatgdi Wrote: [ -> ]What brand/model of Infinibad HBA adapter is used within each system?(X4 SDR interconnect)
What brand/model of Infinibad switch did you acquire?
What type of cabling is used from each adapter to the switch?(Fibre or cx-4 attached copper)
What version of Linux/Ubuntu did you test with?(12.04 or 12.04.1x64) Was ther native supprot for adapter drivers?
Was there any draw-baks interms of speeds based on the infiband x4 SDR technology that you used vs. x4ddr/x4qdr?

I'm using old Mellanox MHEA28-XT HCAs and a Cisco SFS7000P / Topspin 120 switch. But it doesn't really matter what you get, the open drivers will support any Infiniband hardware from what I understand. This specific setup uses all copper/CX4 cabling.

All nodes are running amd64 Ubuntu 12.04 LTS. Everything works out of the box after loading the right modules and bringing up ib0.

4x SDR is plenty of bandwidth for what I have. I'm actually not breaking 1 Gbps at the moment. But Infiniband mitigates latency.