Casey and Amelia discuss the exploitative culture of big tech in the Bay Area, question whose standards define 'the best novel,' and draw parallels between being duped by social media and the risk of repeating that with AI.
14:28Amelia HrubyI'm curious. You shared about kind of your background. You mentioned kind of not being so interested in it anymore. Where are you currently at with, like, using or not using AI?
14:38Casey ZabalaI don't use AI. I don't have a need for it at this point, but I'm really trying to be open minded about this because I do think, you know, as I mentioned, I'm in the tech world. My partner works in the tech world, and they always remind me, you know, people like you were like this about the Internet, said they weren't gonna use the Internet and, you know, see what happens. Now we must use the Internet. So I'm trying to be open minded as I navigate this.
15:10Casey ZabalaI also wanna mention I the one thing I'd actually, like, did use aside from asking business questions was trying to use it as a research tool. And I found that to be extremely disappointing because I would ask these questions. And as a researcher, what I'm after are, like, primary sources or scholars who have done the work or, you know, I'm looking for a bibliography. And the the answers I would receive from these AI models would be hard to source. And I kept being like, what's your source?
15:48Casey ZabalaPlease cite your source, was, like, what I kept asking for. And I would find out that they were giving me inaccurate information a lot of the time. And so I think that was also a moment for me of like, okay. This is not useful for me. I'm going to return to using the library and using the research tools that I know how to use And being oriented in the Bay Area, I also have a real window into what you were saying around the culture behind the people creating these models.
16:25Casey ZabalaI'm very aware of the extremely exploitative nature of technology, big tech, at this point. I see the people who are in the industry really struggling, struggling with their mental health, struggling just to keep up with the demands of the industry that is, like, late stage capitalism on steroids. And so I do come back to that framework of, you know, who is behind these models? What is their definition of good? What is their definition of success?
17:04Casey ZabalaWhat is their definition of the best novel ever written? I love hearing that trope of, like, AI is gonna write the best novels. It's like, but, like, but what are
17:15Casey Zabalastandards? Western white male standards of the best novel? So that's something that I'm really stuck on at this point is who's profiting, who are they exploiting, and how is it going to really be a disservice to humanity if it's not regulated in a way that makes it safe for people to use? And under capitalism, I just don't see that happening. And under fascism, which The US is currently under.
17:51Amelia HrubyYeah. I really feel like, perhaps similar to you, I mean, I spent last year just kind of, like, looking and listening. I I felt like I was a bit in, like, wait and see mode. I wanted to be open because I didn't and don't wanna be that person who said the Internet was gonna ruin everything, but then now everyone uses the Internet. Right?
18:11Amelia HrubyLike, I I don't wanna be that person, and I love technology. But I think similarly to what you're saying, like, a sticking point for me has just been that I felt like I got taken on the ride of social media and totally duped through, like, oh, this is gonna be so good for me. It's so connective. I love it. I gave so much of my life to it.
18:29Amelia HrubyAnd then realizing how, like, harmful and exploitative those algorithms and those companies have become. Like, I don't wanna go down that path again. And I think that there are a lot actually a lot of people like us who see very clearly that the AI companies function that way, and we don't wanna go down that path. And for me, that is actually where I kind of return to, like, the original places I learned about AI. Right?
18:57Amelia HrubyLike, I still love what Holly Herndon did. She made her own large language model or, like, small language model or whatever it would be. Right? Like, she's working with the technology. Like, I don't think personally, I don't think that, like, AI in and of itself is bad.
19:11Amelia HrubyI love when technology evolves. I would love to have programs, like, on my computer that where I can run, you know, models from my own self or something like that. I even use, like, AI transcription models that are on device and, like, are privacy focused. I think all of that is wonderful. For me, the sticking point is really, like, who owns these companies and what are they doing with my information that I'm handing over to them if I use ChatGPT or Claude or whatever.
19:43Casey ZabalaRight. I think about it from sort of like the magical spirits spiritual side of things. And the metaphor that I always think about is, you know, when you're channeling something or you're a medium, it's so important to understand what you're channeling, to, like, have an understanding of what that spirit is, what their name is, how to be in right relationship with that spirit. There's, like, lineage and tradition there that's important, and that creates a safe container for that spiritual connection. Same with using technology of any kind, social media as well.
20:16Casey ZabalaLike, I really realized that I wasn't didn't have the correct boundaries with social media. Right? It I was not a safe space for me to, like, share information in social media because I'm not in agreement with the energies behind the algorithm. Right? And so it feels very similar to me.
20:42Casey ZabalaI think I have hopes that there will be versions of this technology that are safe and creative and collaborative and do solve problems that we have as humans. And it's really just like a tragedy of inequity that we are experiencing now because there is a way that AI could
21:12Casey ZabalaI don't know, inequity itself. Right? If we were to say, like, how can we create a system that allows all human beings to have, you know, universal basic income? And it creates a great solution for that, which is probably tax all the billionaires. Yes.
21:37Casey ZabalaAnd then people were willing to be like, great solution, large language model. Let's do it. You know? So there's just you know, there's the issue of the algorithm itself and who created it, and then there's the people who are pulling the levers behind the scenes. And I think a lot of us are are really conscious of that right now as we navigate these gross power dynamics.
22:03Amelia HrubyYeah. Absolutely. And I really think that's where, like, Cara How's book, Empire of AI, or the book I really love, Parmi Olson, Supremacy. Like, what both of those books do is really pull back the curtain on the founders of these companies and let you see, like, the harmful dynamics they've put in place and, like, the very egoistic ways that they're building even when something like o OpenAI is trying to say, like, oh, this is on the foundation of a nonprofit, etcetera, etcetera. So there's so much there that I'm really glad that we've underscored, and I wanna continue talking more about like, you wrote a really beautiful piece called how AI is ruining your intuition, which I really wanna spend kind of the bulk of our conversation with.