• 0 Posts
  • 22 Comments
Joined 1 year ago
cake
Cake day: July 18th, 2023

help-circle







  • Actually most (I think all, but not 99% positive) machine learning models are incapable of doing straight arithmetic. Due to the way they are built ML models, including deep learning models, can only learn relationships in a limited input space.

    This is most apparent when you test LLMs on different arithmetic operations:

    • For addition, it does okay up until you get to millions or billions
    • Multiplication I think breaks at the 100/1000 level
    • exponents almost break immediately
    • Give it decimal values and it also breaks relatively quickly for any operation.

    This has to do with the fact that LLMs are effectively multiple layers of linear functions, so higher order operations break down faster.










  • It’s not a topic that I’m super well versed in, but here is a thread from a photography forum indicating that news organizations can’t take advantage of fair use https://www.dpreview.com/forums/thread/4183940.

    I think these kinds of stringent rules are why so many are up in arms about how AI is being used. It’s effectively a way for big players to circumvent paying the people who out all the work into the art/music/voice acting/etc. The models would be nothing without the copyrighted material, yet no one seems to want to pay those people.

    It gets more interesting when you realize that long term we still need people creating lots of content if we want these models to be able to create things around concepts that don’t yet exist (new characters, genres of music, etc.)


  • You do realize that newspapers do typically pay the licensing for images, it’s how things like Getty images exist.

    On the flip side, OpenAI (and other companies) are charging someone access to their model, which is then returning copyrighted images without paying the original creator.

    That’s why situations like this keep getting talked about, you have a 3rd party charging people for copyrighted materials. We can argue that it’s a tool, so you aren’t really “selling” copyrighted data, but that’s the issue that is generally be discussed in these kinds of articles/court cases.