I’ve been using ChatGPT, specialized ones on Huggingface, and a bunch of local ones using ollama. A colleague who is into this deep says Claude is giving him best results.

Thing is, depends on the task. For coding, I’ve found all suck. ChatGPT gets you up to a point, then puts out completely wrong stuff. Gemini, Microsoft, and CodeWhisperer put out half-baked rubbish. If you don’t already know the domain, it will be frustrating finding the bugs.

For images, I’ve tried DALL-E for placeholder graphics. Problem is, if you change a single prompt element to refine the output, it will generate completely different images with no way to go back. Same with Adobe generators. Folks have recommended Stability for related images. Will be trying that next.

Most LLMs are just barely acceptable. Good for casual messing around, but I wouldn’t bet the business on any of them. Once the novelty wears off, and the CFOs tally up the costs, my prediction is a lot of these are going away.

Asked several to write a c implementation of some basic networking stuff.

ChatGPT: needed to refine my input, got reasonable output. Complete answers, just compile and run.

Google: the output was just a few snippets, nothing to be used as-is.

MSFT: terrible output, and -no suprise here- the compiled code crashed with null pointer references etc. The worst answers ever.

For simple problems (programming low-level microcontrollers), my go to will be ChatGPT everytime.

Google should get it’s act together, Microsoft can exit the stage.

Llama3 local is pretty good

No one mentioned Phind or Perplexity, both are niiice.

There are no good LLMs.