You can overwrite the model by using the same name instead of creating one with a new name if it bothers you. Either way there is no duplication of the llm model file

Can you try setting the num_ctx and num_predict using a Modelfile with ollama? https://github.com/ollama/ollama/blob/main/docs/modelfile.md#parameter

Are you using a tiny model (1.5B-7B parameters)? ollama pulls 4bit quant by default. It looks like vllm does not used quantized models by default so this is likely the difference. Tiny models are impacted more by quantization

I have no problems with changing num_ctx or num_predict

Ummm… did you try /set parameter num_ctx # and /set parameter num_predict #? Are you using a model that actually supports the context length that you desire…?

You don’t get to make requests lol

It’s so infuriating, but when has CNN ever attempted to appear objective? They have been blatant controlled opposition for a while now. Their playbook is to platform misinformation and repackage far right talking points into words that are palatable to liberal and centrist viewers.

Make maintainable changes to the services you use and your behavior/habits related to privacy. Go at a gradual pace that won’t interupt your daily life.

Worry about things that you can control. You can only do your best. It doesn’t have to be perfect. You might not be 100% secure and private, but that doesn’t mean you have to make it easy to be tracked.

Start with low hanging fruit and easy changes.

Like switching web browsers; installing adblocking and privacy oriented addons (jShelter is a good one); switching to a more private search engine; setting privacy settings in apps and services; using strong, unique passwords and a password manager; replacing more and more software that you use with FOSS alternatives; use a good VPN.

If you’re ready for it, get or build a NAS and self host instead of using cloud-based services. Set up a pihole server for network-level protection from trackers and ads.

Well shit, I was about to make the switch to Proton for email… glad I’ve been lazy about it, now. I’ll figure something else out, mail-in-a-box looks like what I really want anyway

No.

Weird, with just jShelter alone, I get “Your browser has a randomized fingerprint” on both desktop and mobile. Firefox browser

My guess is an x86 32bit machine

4690k was solid! Mine is retired, though. Now I selfhost on ARM

Yes lol

No touchpads? Not even a contender lmao

It’s only partly true. I am a bit exhausted but not as much as I am just done with the controlled-opposition bullshit propaganda.

I think the difference is the strict roles and specifically the wife that is submissive and exclusively plays the role of child rearer and homemaker. There’s nothing “right wing” about being heterosexual, its the forcing everyone to be and to be heterosexual in the predefined style they demand.

Honestly, I believe that you already understand this unsubtle and obvious distinction and that your comment is not in good faith

It’s only partly true. I am a bit exhausted but not as much as I am just done with the controlled-opposition bullshit propaganda.

Donated.