• 0 Posts
  • 24 Comments
Joined 2 months ago
cake
Cake day: December 9th, 2024

help-circle





  • I haven’t gotten to the finance part yet but his discussion on the state of AI currently is excellent. I’m going to post something later about my experiments with DS-R1 in offline form and playing with “the big model” through their apps. The differences are pretty interesting and the big model is quite impressive.

    Are you making any investment decisions today? I was thinking it might be a good day/week to “buy the dip” assuming NVidia actually is still a valuable company and will likely experience some overcorrection in the opposite direction. It’s been jittering all day but the downward trend continues for the moment.

    Edit:

    Wanted to add that I also read this today and he has some different insights to DS as well. In particular, he thinks DS is being honest in their costs, and does some analysis on how their optimizations make their claims of computing on a lot of H800 chips plausible.

    He also talks about how DS-R1 uses a somewhat different chain-of-thought/reasoning model than ChatGPT o1. They used RL (no HF!) to have DS “teach itself” how to reason. To me, that’s maybe the most alarming bit. I’d been confident this approach wouldn’t get to AGI but with these techniques… I dunno, maybe we’re much closer to bootstrapping and the AGI revolution than expected? Like…within 2 or 3 years maybe?

    Ah, the OP also mentions this:

    With R1, DeepSeek essentially cracked one of the holy grails of AI: getting models to reason step-by-step without relying on massive supervised datasets. Their DeepSeek-R1-Zero experiment showed something remarkable: using pure reinforcement learning with carefully crafted reward functions, they managed to get models to develop sophisticated reasoning capabilities completely autonomously. This wasn’t just about solving problems— the model organically learned to generate long chains of thought, self-verify its work, and allocate more computation time to harder problems.



  • I liked John Dies At The End because it does sort of present the case “what if a contemporary, cynical person was exposed to an existential crisis” and I find their approach a lot more relatable.

    Like I don’t want to brag about what strong stuff I’m made of but Lovecraft would have cant-breath-panic-attacks because black people existed or would need to hide in his house for several days because a woman spoke to him.

    Like I feel like some Sims would be mind blown about it, but a lot more would be pissed. Can you imagine if God showed up, proved He was real, then explained that all your suffering is for His entertainment?







  • They mean slightly different things in places too because of regional need. In Texas, a “freeway” is a road without tolls on it, which would be a tollway. Because there’s a lot of private, pay-as-you-go roads in TX.

    Likewise “highway” is sometimes literally an elevated multilane road.

    I wonder if the traditional exemplars of this (yall vs yous guys vs you or coke vs soda vs pop) have been so flattened out by the internet that they aren’t as divided in use any more? People all over use yall now, I guess pop v soda is still a thing but southerners refer to generic “coke” less than they did in my youth.





  • Google announced that something like 25% of their code is AI generated now, and it’d be hilarious how much these companies have enshittified themselves into a cycle of constant self-owns except that we keep suffering for it too.

    Like every google app and service is bad now. Search sucks. YouTube apps are bloated, have been crashing, and the algorithm is serving up just random stuff now. G Maps won’t stay open on my phone, and randomly minimizes itself. Gmail is out of space, full of newsletters, and also degrading in search.

    Facebook is the same deal. I’ve been on it more recently because I need to track events and it’s all anyone in this city uses. Searching for the name of an event, which you’ve stated you’re going to, by it’s exact name, will find nothing, or an older version of the event from 4 years ago. The feed is 90% ads and sponsored posts, mostly videos. And the videos aren’t ads, they’re just random tiktok-wannabes about paint mixing or machining stuff. It’s utterly bizarre to be inundated with clickbait that desperately wants your attention for no reason.

    I consider myself a pretty good engineer and it’s amazing how little these companies can accomplish with literally tens of thousands of developers. Its another of the great paradoxes of our times: individually, software devs must be among the least productive workers of all time, and yet as a group the profession (the computer itself really) has realized such astronomical productivity gains that we’re probably already past the point where anyone really needs to work full-time ever again.


  • I looked into doing something similar with Wikipedia and the recommendation is also to use Kiwix, and the offline file size is also very large.

    Welcome to the collapse! Hoarding “clean data” for personal use is like hoarding clean water and food: you need a place to keep it, and it starts going stale the minute you shelve it. So either buy a digital bunker to load up with what you need or ask the all knowing AI gods for answers like the other poors.

    Also the Stack Exchange software used to be open source, surely there’s still a fork somewhere. You could certainly run your own Developer QA site, but like with Lemmy, the problem then is getting enough traffic to be able to productively tap into the collective wisdom.

    (Edit: sorry, this comes across mean spirited but I’m honestly sympathetic and just nihilisticallly frustrated to be in a similar situation. I foresee a big NAS and a lot of downloads in my future, but I hope we also find ways to share our forbidden knowledge until the day it can be free again)


  • I also stopped posting there years ago for much the same reason. You could feel the strangulation of the community as duplicate questions started getting shouted down, posts got turned into “community wikis” against your will and your own questions started getting edited to better fit someone else’s plans and ideologies. The company was sold shortly after, so maybe animals can sense their pending extinction (some of them anyway)?

    I miss those days when writing an answer genuinely felt like helping to grow the global community of friend developers. It’s a shame no technology has been discovered that will let the small amount of collective good in us all work together against the assholes, but alas it seems the opposite is always true.