This is probably the easiest tool I’ve used to run them: https://lmstudio.ai/
There’s tons of models available here, some of them fairly large: https://huggingface.co/
No, I’m pretty sure there’s no way to run any larger than your RAM/VRAM, at least not automatically. You can use storage as RAM, but that’s probably not a good idea. It’s orders of magnitude slower. You’re better off running a smaller model.
Yeah, most likely, and it’ll only bind users and protect the businesses, as always.
It already is broadly accessible to the general public. They just don’t know about it or just accept using one of the cloud versions. It’s trivial to get up and running at this point.
The model should take into account income. For an open-source model it should be free. It’s using public data to produce a public product. For a for-profit model it should be paid. If they’re profiting off of public data then they should have to pay for the right to use it.
We can’t afford to make any of this. We don’t have the money for the compute required or to pay for the lawyers to make the law work for us. It should benefit the people, so it needs to change. It needs to be “expanded” (I wouldn’t call it that, rather “modified” but I’ll use your word) in that it currently only protects the wealthy and binds the poor. It should be the opposite.
As with all things, nuance and context is required. I don’t think we should be taxing poor people that heavily (if at all), but does that mean I should be against taxing the ultra-wealthy more? Obviously not.
I support copyright to protect developers and not hinder users, hobbyists, or the average person. I don’t support it to only help massive companies who can manipulate the law to protect them from competition, but also not hinder them from stealing from the masses. They can afford to pay. If AI is actually as valuable as they say, the price of paying for the training data is trivial.
Copyright shouldn’t only be helpful to big businesses. It should be most helpful to the average person. We have the opposite here. I support modifying copyright law to bind big businesses and liberate individuals. I don’t need to be totally against it like you imply.
I had the idea to use an old phone as a server recently. Phones are pretty energy efficient, so it seems like it’d be a smart way to recycle one. Does anyone know if this is actually a good practical idea for a lightweight personal server, rather than just a novelty? I haven’t heard of anyone doing it before so I’m assuming there’s a reason it isn’t a good idea, but I don’t know what that’d be.
No browser with third party investors can be really independent, they always will obey more the interests of the investors as on those from the users.
That’s why they limited donations to $100k per organization. No one is allowed to make themselves indispensable to the project.
LLMs don’t have no utility. They just aren’t good for everything. This is a reasonable use for them. Actually giving accurate information, not so much. Definitely not doing that require intelligence or creativity either. They’re text prediction algorithms. Using it to find the right text is what it should be good at.
Discord has quite a few good features that IRC doesn’t. I will agree that it being used as a replacement for a forum, while also being unsearchable, is amazingly stupid. However, it’s used by almost everyone for a reason, and to ignore that (if you were to develop and alternative) ensures you won’t succeed. Yeah, we don’t need every feature from Discord, but easy voice/text/video chats, image/file sharing, and all the other useful things are required. Yeah, we can probably lose the emotes and crap and be fine.
The extensions should work still. It even still integrates with the same extention marketplace. It’s the same software, just the open source part without the MS stuff —which honestly, I have and do use both and I don’t know what the difference is.
It’s definitely worth checking out. If it doesn’t work for you then still nothing is lost except a small amount of time, but I’m willing to bet it does.
Can you choose to use VSCodium instead? It’s practically identical, but isn’t controlled by MS.
There’s other methods of preventing scraping rather than requiring us to give up our data to view the content. Maybe they’re perfect and it doesn’t get sold or abused, but how can we know that for every single site? Also, how to we know it’s secure forever, even when they enahitify in the future?
They don’t have to be evil or scamming people for this to be a shitty barrier that prevents people from viewing the information.
I’m not the person who brought git up. I was just stating that work is work. Sure, git is doing something useful with it. This is arguably useful without the work itself being important. Work is the thing you’re complaining about, not the proof.
This solution is designed to cost scrapers money; it does this by causing them to burn extra electricity. Unless it’s at scale, unless it costs them, unless it has an impact, it’s not going to deter them.
Yeah, but the effect it has on legitimate usage is trivial. It’s a cost to illegitimate scrapers. Them not paying this cost also has an impact on the environment. In fact, this theoretically doesn’t. They’ll spend the same time scraping either way. This way they get delayed and don’t gather anything useful for more time.
To use your salesman analogy, it’s similar to that, except their car is going to be running regardless. It just prevents them from reaching as many houses. They’re going to go to as many as possible. If you can stall them then they use the same amount of gas, they just reach fewer houses.
Compare this to endlessh. It also wastes hacker’s time, but only because it just responds very slowly with and endless stream of header characters. It’s making them wait, only they’re not running their car while they’re waiting.
This is probably wrong, because you’re using the salesman idea. Computers have threads. If they’re waiting for something then they can switch tasks to something else. It protects a site, but it doesn’t slow them down. It doesn’t actually really waste their time because they’re performing other tasks while they wait.
Let me make sure I understand you: AI is bad because it uses energy, so the solution is to make them use even more energy? And this benefits the environment how?
If they’re going to use the energy anyway, we might as well make them get less value. Eventually the cost may be more than the benefit. If it isn’t, they spend all the energy they have access to anyway. That part isn’t going to change.
Proof of work is just that, proof that it did work. What work it’s doing isn’t defined by that definition. Git doesn’t ask for proof, but it does do work. Presumably the proof part isn’t the thing you have an issue with. I agree it sucks that this isn’t being used to do something constructive, but as long as it’s kept to a minimum in user time scales, it shouldn’t be a big deal.
Crypto currencies are an issue because they do the work continuously, 24/7. This is a one-time operation per view (I assume per view and not once ever), which with human input times isn’t going to be much. AI garbage does consume massive amounts of power though, so damaging those is beneficial.
It could be infinitely wide too if they desired. It shouldn’t be that hard to do I wouldn’t think. I would suspect they limit the time a chain can use though to eventually escape out, though this still protects data because it obfuscates legitimate data that it wants. The goal isn’t to trap them forever. It’s to keep them from getting anything useful.
Yeah, at this point Blender is ahead in a lot of areas already. It’s just that companies are slow to change and also (I assume) they think it looks less professional to use the free software, regardless of the massive advantages like new employees already being familiar with it.
That probably ideal, but it should still be spread out so the “less important” projects still get something.
Donations add up. If everyone did what you’re proposing, many projects would likely get no donations. Ideally everyone would donate a small amount to every project they use, which would all add together to be a sizable amount for all projects that are frequently used.
We aren’t all one person. We don’t need to all act as if we’re one. We should act as if we’re a community, because we are. Support all projects, and they’ll all get support.
After putting my computer to sleep, it would immediately wake back up. Eventually found out it was my Logitech wireless dongle that was causing the issue. I had to create a script that disabled USB ports during sleep and a systemd service to make sure it activated on every boot.
Thanks for this. I’m going to look into it. This happens on my computer, but it’s been happening for years, which includes a long time on Windows. I had pretty much given up on it because I’ve tried unplugging just about everything and it still happens. It might be something else for me.
For the Nvidia issues, that hopefully shouldn’t be an issue soon after the open source drivers. The few mostly solvable issues with Linux are quickly dissolving.
The way that could be done would be significantly worse than 15 slower. That’s the issue. Even with the fastest storage, moving things between RAM and storage creates massive bottlenecks.
There are ways to reduce this overhead by intelligently timing moving pieces between storage and RAM, but storage is slow. I don’t know how the models work, if it is possible to know what will be needed soon, so you can start moving it into RAM before it’s needed. If that can be done then it wouldn’t be impossibly bad, but if it can’t then we’re talking something like 100x slower maybe. Most of these are already pretty slow on consumer hardware, so that’d be effectively unusable. You’d be waiting hours for responses.