You must log in or register to comment.
I’ve tried it too. The nous_hermes model worked very well ( except that its a little slow than chatgpt )
Nice, I don’t have enough RAM 🐏
Used it today to write some reports, really impressive considering it is running locally
Any client for Android ?
Unfortunately No. you need a CPU with AVX instructions to run the model. This software has an option to enable API access, so in theory you can write an app for that
👍
