Nyfure

Dont. They are notoriously bad at such things. Lack of Hardware acceleration mainly. These old Chips and problems with single-board-complications are just not worth it at such high prices.
An Intel N100 MiniPC will have much more compute with less complications.

Just saw it too :D

Why would you ever need such a feature? Closed.

We cant read Apples mind, so thats wishful thinking. But sending telemetry (even if hidden) means it can be used.
Thats why e.g. Apple is using Differential Privacy for apps to use… to not have to give the Apps full access to e.g. usage data.
Of course Apple themselves isnt necessarily bound to that system themselves, who knew…

And why not allow other Apps to replace your default Apps if you want to? Why not have access to that Freedom?
After all you should be able to do anything you want with your system… or maybe you dont believe in this kind of freedom. Could just buy an Android phone. Fuck the person who wants to actually own their hardware, right? How could they be so dumb and want actual freedom, haha.
No, we play pretend while Freedom is further taken away under “Privacy” claims. Maybe that replacement battery will send your usage pattern via shortwave radio to an agent nearby…

you want a frontend, not the “service” itself.
Under “service” i usually understand the main logic part of something. In this case the LLM-processing itself.
Thats probably where the confusion is coming from here.

Please include the actual calculations for energy-prices as many, you may not know, live in different locations and pay different prices compared to you.

Hetzner Storagebox is $3.5/M for 1TB

As far as i understood tailscale funnel its just a TCP-tunnel.
So you handle TLS on your own system, which makes sure tailscale cannot really interfere.

If you already trust them this far, might aswell do the same with a VPS and gain much more flexibility and independence (you can easily switch VPS provider, you cannot really switch tailscale funnel provider, you vendor-locked yourself in that regard)

I’d connect the VPS and your home system via VPN (you can probably also use tailscale for this) and then you can use a tcp-tunnel (e.g. haproxy), or straight up forward the whole traffic via firewall-rules (a bit more tricky, but more flexible… though not that easy with tailscale… probably best to use TCP-tunnel with PROXY-Protocol).
This way you can use all ports, all protocols, incoming and outgoing traffic with the IP-Address of the VPS.

Tailscale might even already have something that can configure this for you… but i dont really know tailscale, so idk…

And as you terminate TLS on your home-system, traffic flowing through the VPS is always encrypted.

If you want to go overboard, you can block attackers on the server before it even hits your home-system (i think crowdsec can do it, the detector runs on your home-system and detects attacks and can issue bans which blocks the attacker on the VPS)

And yes, its a bit paranoid… but its your choice.
My internet connection here isnt good enough to do major stuff like what i am doing (handling media, backups and other data) so i rent some dedicated machines (okay, i guess a bit more secure than a VPS, but in the end its not 100% in your control either)

Many systems dont support subpaths as it can cause some really weird problems.
As you use tailscale funnels, you really want incoming traffic from the internet. I am not sure thats a good idea for e.g. homeassistant that is limited in access anyways.
Might aswell use tailscale and access the system over VPN.

And for anything serious i wouldnt use something like funnel anyways. Rent a VPS and use that as your reverse-proxy, you can then also do some caching or host some services there. Much simpler to deal with and full support for such things as you then have an actual public IPv4/IPv6 address to use.
Heck, dont even have to pay for it with the Oracle Always-Free system.

How much time do you have? Because even small models will take alot of time on that kind of hardware to spit out a long text…
And the small models arent that great. I think the current best and economic model would be a mistral, mixtral or dolphin.
If you got the power, nous-capybara is very good and “only” 34B parameters (loading alone needs like 40GB of memory).

Windows has a request assistance function? wtf… where is that found?
I only know Remote desktop tools and most of these work perfectly fine on linux as the client or even under Wine.

[Edit: woah, i did some rambling below here… not related to your specific case here, but some nice information maybe]

Linux as host is where it gets funny… bigger ones support X11, pretty much none support Wayland.
To be fair, its impossible to control mouse and keyboard under Wayland without root.
I think we now have some new desktop packages for gnome and kde which can do that, so now they need to be implemented.

But i dont see an effort being made for Wayland by the bigger providers in the near future… the market just isnt there and there is lots of uncertainty with the featureset.

Switched to Rustdesk a while back, works nicely as client, but only picture output with wayland as host.l as of now.
And i cannot copy&paste under wayland as client… even though it worked before…

The question then is, how much can you actually do in the shell.
Good luck setting up many programs that way when they soley rely on the GUI and documentation about configs or their database structure is nonexistant.

afaik they also alias common linux/gnu commands like curl… but the syntax isnt like curl at all

To be fair, you can check the code they run or just use the API.
The hash is calculated locally, cut-off and then send, the server returns all hashes it found which start with your one and then you can check if yours in in the list locally.

To be fair, windows development also included UI changes beneficial for users, so its not necessarily bad to copy those.
Of course there are many which are… questionable, we of course shouldnt copy those :D

We sometimes get weird scam-sms, but thats about it.
(We is my family, other people dont really talk about it with others that much)

No, selling would also not be allowed via a cookie banner as the cookie banner doesnt address that.
GDPR already doesnt allow usage of PII which you cannot find legitimate reasons for. Just selling PII is never allowed as you will not find a legitimate reason for doing so.
But the cookie banner can allow more invasive tracking via setting tracking cookies which can be covered under legitimate interest for the operator of the website themselves.

Was done before too, but now the websites simply need a banner for using categories of cookies which require it (tracking, marketing, …)
And we already have GDPR at least limiting activities in a broad sense. (of course lots of leeway, but still much better than before)
You cannot do more with a cookie banner you couldnt already do before.

You dont need a cookie banner if you dont want to invasively track the users.
So its really the fault of the websites for wanting to use categories of cookies which do require a banner (ad and tracking).

Index of repositories is held locally, so if you use the same repository with multiple machines, they have to rebuild their index every time they switch.
I also have family PCs i wanted to backup too, but borg doesnt support windows, so only hacky WSL would have worked.
But the worst might be the speed of borg… idk what it is, but it was incredibly slow when backing up.