• 0 Posts
  • 22 Comments
Joined 1 year ago
cake
Cake day: July 3rd, 2023

help-circle


  • I don’t agree that ChatGPT has gotten dumber, but I do think I’ve noticed small differences in how it’s engineered.

    I’ve experimented with writing apps that use the OpenAI api to use the GPT model, and this is the biggest non-obvious problem you have to deal with that can cause it to seem significantly smarter or dumber.

    The version of GPT 3.5 and 4 used in ChatGPT can only “remember” 4096 tokens at once. That’s a total of its output, the user’s input, and “system messages,” which are messages the software sends to give GPT the necessary context to understand. The standard one is “You are ChatGPT, a large language model developed by OpenAI. Knowledge Cutoff: 2021-09. Current date: YYYY-MM-DD.” It receives an even longer one on the iOS app. If you enable the new Custom Instructions feature, those also take up the token limit.

    It needs token space to remember your conversation, or else it gets a goldfish memory problem. But if you program it to waste too much token space remembering stuff you told it before, then it has fewer tokens to dedicate to generating each new response, so they have to be shorter, less detailed, and it can’t spend as much energy making sure they’re logically correct.

    The model itself is definitely getting smarter as time goes on, but I think we’ve seen them experiment with different ways of engineering around the token limits when employing GPT in ChatGPT. That’s the difference people are noticing.




  • Someone close to me is a HS teacher. During covid, the schools changed their policy from “no phones in class ever” to “you can have your phone in class but you’d better only use it to help with classwork or in an emergency.”

    They’ve been trying to reverse the policy back to how it was, but it’s hard to get all the kids to believe that they can’t do this anymore. They don’t take the threat of punishment seriously because everyone is doing it now.

    Even if you manage to deal with the phone issue, the school gives kids chromebooks now to do their work on. The student wifi network seemingly has no restrictions, since the teachers sometimes need to have them watch something on YouTube or Netflix.

    So kids, during class, watch Netflix on their Chromebook instead of paying attention.






  • I like writing stupid Reddit comments. If they want to pay me to do it, now matter how much or little, that’s more than I’m getting paid to shoot the shit in my downtime anywhere else.

    But “residuals” are where it’s at. Old comments that never die because people keep gilding or replying. Views on that content can be (and we’re dealing with Reddit, so they very well could screw it up) turned into ad dollars. Companies are turning more of their tv ad dollars to social media.

    Idk. I don’t disagree, but I think the cynicism may prove wrong here. But the cost of participating is zero if it turns out I get residuals on a comment I wrote 9 years ago.




  • If that ends up being true it very well may pull me back to Reddit, but only to write comments that I think people will upvote. When Reddit gave out auto-generated avatars in the past, it gave me one that said it was for writing funny comments that get lots of upvotes, so they must have some logic assessing how the community responds to individual commenters.

    I’d still be pissed off about how they rolled out their recent changes, but it wouldn’t surprise me if they actually had a halfway decent plan here but bungled it all by rolling it out too slowly without making it clear how one dot (keeping users in an ecosystem to make sure they see ads) connects to another (creating a community that can support a model to pay contributors).

    YouTube pays contributors who attract audiences. Why shouldn’t Reddit? That’s the best possible thing commercial social media can do for its users.

    It would change the Reddit community, though. I wouldn’t be there to hang out, I’d be there to work and create content tailored to… what Reddit likes.

    But I can’t deny that it would attract my interest.






  • I think we’ll see a variety of servers with different funding models, similar to how radio and tv stations in the us can have a variety of funding models. NPR has a network of member stations that all carry their content (if the stations want, or they can get content from another station, or they can make it themselves).

    Threads is an example of a federated service with a corporate funding model. I definitely think it’ll survive since they have as much money as Facebook wants to sink into it.

    But we’ll probably also see servers that run on donations by a dedicated community.

    If Threads is the NBC/CBS/ABC of the federated landscape, then those small servers will be like public radio stations, which operate on donations and the occasional government grant.

    I think there are people who would chip in a little bit to fund a non-commercial server just the same as there are people who chip in money to NPR.