hashcat Forum

Hey so I'm trying to run cudaHashcat64 which for what ever reason isn't included in the The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali) Linux repos when installing oclHashcat. But I figure that is more than likely a The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali) issue then an issue with HC itself. So I downloaded the package from the Hashcat site and am running it manually. The only problem is it isn't running.

Basically I just got some new hardware for my main computer, and I thought I could load The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali) on my old core2quad and just have that push the GPU for cHC. Instead of bogging down my main system. It should be a win win. I am connecting to the machine through SSH. Although I am probably going to install a VNC server tonight, since the machine will be permanently behind my firewall. Does anyone have any ideas on how to fix this error? I have included as much information as I could think of in the code below. Any suggestions, are appreciated.

I am a Linux noob, I have been using the windows version of cudaHashcat for the last year or so. But I'm not paying for another license of windows just for this project, I'm cheap.

Code:
root@breaker:~# nvcc --version

nvcc: NVIDIA (R) Cuda compiler driver

Copyright (c) 2005-2012 NVIDIA Corporation

Built on Fri_Sep_21_17:28:58_PDT_2012

Cuda compilation tools, release 5.0, V0.2.1221

root@breaker:~# nvidia-smi

Wed Oct  8 10:48:08 2014

+------------------------------------------------------+

| NVIDIA-SMI 331.67     Driver Version: 331.67         |

|-------------------------------+----------------------+----------------------+

| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |

| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |

|===============================+======================+======================|

|   0  GeForce GTX 660     Off  | 0000:01:00.0     N/A |                  N/A |

| 30%   29C  N/A     N/A /  N/A |    101MiB /  2047MiB |     N/A      Default |

+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+

| Compute processes:                                               GPU Memory |

|  GPU       PID  Process name                                     Usage      |

|=============================================================================|

|    0            Not Supported                                               |

+-----------------------------------------------------------------------------+

root@breaker:~# lspci -nnk | grep -i vga -A3 | grep 'in use'

        Kernel driver in use: nvidia

        Kernel driver in use: snd_hda_intel

root@breaker:~# pyrit list_cores

Pyrit 0.4.0 (C) 2008-2011 Lukas Lueg https://pyrit.googlecode.com

This code is distributed under the GNU General Public License v3+

The following cores seem available...

#1:  'CUDA-Device #1 'GeForce GTX 660''

#2:  'CPU-Core (SSE2)'

#3:  'CPU-Core (SSE2)'

#4:  'CPU-Core (SSE2)'

root@breaker:~# '/root/cudaHashcat-1.31/cudaHashcat64.bin' -b

cudaHashcat v1.31 starting in benchmark-mode...

Device #1: GeForce GTX 660, 2047MB, 1124Mhz, 5MCU

ERROR: cuModuleLoad() 209

Please use "7z x" instead of "7z e" to unpack the .7z. Then it should work.

(10-08-2014, 04:58 PM)atom Wrote: [ -> ]Please use "7z x" instead of "7z e" to unpack the .7z. Then it should work.

Hey Atom,
I quickly deleted the old hashcat file as well as the outfiles and infiles to make sure there were no issues.
I then ran "7z x cudahashcat-1.31.7z"
This was my output it appears to be the same issue:

Code:
root@breaker:~# '/root/cudaHashcat-1.31/cudaHashcat64.bin' -b

cudaHashcat v1.31 starting in benchmark-mode...

cudaHashcat, advanced password recovery

Purpose

Software has been created for scientific, analyzation, demonstration and

sportive reasons. It is a dual-use tool under federal german law in the

meaning of the Convention on Cybercrime, Budapest, 23.XI.2001. Usage

restricted to legal use.

License agreement

1. All copyrights to this program are exclusively owned by the author --

atom

2. You may only use this software for legal purposes.

3. THIS PROGRAM IS DISTRIBUTED "AS IS".  NO WARRANTY OF ANY KIND IS

EXPRESSED OR IMPLIED. YOU USE THIS SOFTWARE AT YOUR OWN RISK. THE AUTHOR

WILL NOT BE LIABLE FOR DATA LOSS, DAMAGES, LOSS OF PROFITS OR ANY OTHER

KIND OF LOSS WHILE USING OR MISUSING THIS SOFTWARE.

4. If your countries law(s) do not allow restrictions as in (3.) you

need to get an additional, written and individual license by the

copyright holder to use this software. Unless you have such a

license, you are not allowed to use the software.

5. You may not rent, lease, sell, modify, decompile, disassemble, or reverse

engineer this program or any subset of this program. Any such unauthorized

use shall result in immediate and automatic termination of this license and

may result in criminal and/or civil prosecution.

6. Redistribution of the original package, in whole or in part, or a modified

version as needed for distribution packaging is permitted without restrictions.

Enter YES in uppercase if you accept this EULA: YES

Device #1: GeForce GTX 660, 2047MB, 1124Mhz, 5MCU

ERROR: cuModuleLoad() 209

Like I stated before I am a bit of a linux newbie in when it comes to configuration, however I am comfortable in the CLI. Is it possible that I am missing a dependency? I googled and found the ldd command this is my output from that:

Code:
root@breaker:~# ldd '/root/cudaHashcat-1.31/cudaHashcat64.bin'

        linux-vdso.so.1 =>  (0x00007fff86de6000)

        libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007fa904705000)

        libnvidia-ml.so.1 => /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1 (0x00007fa904466000)

        libcuda.so.1 => /usr/lib/x86_64-linux-gnu/libcuda.so.1 (0x00007fa903501000)

        libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007fa903176000)

        /lib64/ld-linux-x86-64.so.2 (0x00007fa90493e000)

        libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007fa902f72000)

        libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007fa902d5a000)

        libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007fa902ad8000)

        librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007fa9028d0000)

thanks again for all your help, and I love HC, it's straightforward and easy to use... Once I get past myself and the system it's running on.

There are two cases when you see the 209 error:
1. the extraction of the archive did go wrong (please also double-check if /kernels/4318/m00000_a0.sm_30.64.ptx etc exist)
2. make sure there are no other conflicting
- libcuda.so
- nouveau may conflict
- other installed packages may conflict

check with
sudo dpkg --get-selections | grep -i nvidia

and/or
sudo dpkg --get-selections | grep -i nouveau

(maybe also check the loaded modules - lsmod)

Furthermore, if you have the cuda sdk somewhere in your path and especially LD_LIBRARY_PATH etc, that may also conflict.

I had that error on Windows.
The kernels were there, yet it still bothered me.
Atom told me that indeed the error means missing kernels, but that did not help.
The fix was simple: update forceware to latest WHQL.

Alrighty, I had to go to class but I just got back and I was looking into this more, it appears that all of the kernel files are there.

nouveau is blacklisted and should not be running.

here is what my lsmod is showing

Code:
root@breaker:~/cudaHashcat-1.31/kernels/4318# lsmod | grep nvidia

nvidia_uvm             33145  0

nvidia              10651813  29 nvidia_uvm

i2c_core               24265  2 i2c_i801,nvidia

when I run 'sudo dpkg --get-selections | grep -i nvidia' a lot comes up, however when I run 'sudo dpkg --get-selections | grep -i nouveau' I get two entries... I am now removing nouveau since that seems to cause a lot of issues, and since I am early in the install process I can always just re image the machine. Here are the outputs of the two commands now:

Code:
root@breaker:~# dpkg --get-selections | grep -i nouveau

libdrm-nouveau1a:amd64                          deinstall

root@breaker:~# dpkg --get-selections | grep -i nvidia

glx-alternative-nvidia                          install

libgl1-nvidia-glx:amd64                         install

libnvidia-compiler:amd64                        install

libnvidia-ml1:amd64                             install

nvidia-alternative                              install

nvidia-cuda-dev                                 install

nvidia-cuda-doc                                 install

nvidia-cuda-gdb                                 install

nvidia-cuda-toolkit                             install

nvidia-driver                                   install

nvidia-installer-cleanup                        install

nvidia-kernel-3.14-kali1-amd64                  install

nvidia-kernel-common                            install

nvidia-kernel-dkms                              install

nvidia-libopencl1:amd64                         install

nvidia-modprobe                                 install

nvidia-opencl-common                            install

nvidia-opencl-dev:amd64                         install

nvidia-opencl-icd:amd64                         install

nvidia-profiler                                 install

nvidia-smi                                      install

nvidia-support                                  install

nvidia-vdpau-driver:amd64                       install

nvidia-visual-profiler                          install

nvidia-xconfig                                  install

xserver-xorg-video-nvidia                       install

root@breaker:~#

The outside of Hashcat the only things I have installed at this point are openSSH, pure-FTP, and vnc4server.

Maybe I am asking the wrong questions in trying to fix this... Is there a different linux distro that is easier to set up for cudaHashcat? Because ultimately that is all this machine is going to be used for. It is a desktop and unless I feel like scanning my apartment complex 24/7 there is really no other need for the other tools that are included in The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali), I just figured it was one of the go to distros for this purpose.

I have never tried blackbox but I assume that is just as good as The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali). The only requirements I have are SSH, FTP, and VNC other than that distro is not an issue for me.

Cheers guys and thanks for helping a noob like me.

do not install the nvidia driver from apt, install the latest driver from nvidia.com

(10-09-2014, 08:44 AM)epixoip Wrote: [ -> ]do not install the nvidia driver from apt, install the latest driver from nvidia.com

Thank you epixoip, that was the problem I did a fresh install of The-Distribution-Which-Does-Not-Handle-OpenCL-Well (Kali) and went through and manually installed the nVidia drivers and the Cuda tool kit. That worked... now I just have to get it to stop giving me a warning every time I try in install something via aptitude asking if I want to uninstall the non apt version of the drivers. You are the man and if I meet you on the streets I will buy you a beer.

Thanks to everyone who helped me sort this issue.

marpatdroid

atom

marpatdroid

philsmd

Rolf

marpatdroid

epixoip

marpatdroid