Added Dockerfile

[dsingal0]

Lots of people asking for a dockerfile for unsloth, so I added one. Things are very temperamental in the order pip packages are installed especially packaging and flash-attn. I don't see tests, but was checked by training tiny-llama.

[dsingal0]

@danielhanchen
tiny-llama training test
Pushed here too: https://hub.docker.com/repository/docker/alphatozeta/unsloth/tags

[darkacorn]

worth makeing a builder for a few different cuda versions - depending on the arch .. not every card supports 12.1

[dsingal0]

worth makeing a builder for a few different cuda versions - depending on the arch .. not every card supports 12.1

@darkacorn what cards don't support 12.1? I believe everything since Pascal does? It's probably worth adding one for 11.8 for people using older pytorch and pytorch dependent libraries

[danielhanchen]

Oh thanks a lot - very interesting as well - great work!

[GeniusMundi10]

I am getting thr following error when i try to import FastLanguageModel which i do in a script which is inside a docker container which is setup same as your Dockerfile

[GeraudBourdin]

By the way, you can do a specific repo and push images on docker.io this could be helpful for firs timers.

[dsingal0]

By the way, you can do a specific repo and push images on docker.io this could be helpful for firs timers.

@GeraudBourdin what do you mean? I'd prefer not to own unsloth dockerfiles. @danielhanchen do you think you can merge so people can have a dockerfile for unsloth?