Recording: Sentient and Us
The Santa Cruz Works webinar Sentient and Us offered a thoughtful and urgent discussion about one of the defining questions of our time: as artificial intelligence becomes more capable, what exactly are we creating, and how do we ensure it strengthens society rather than weakens it? (get the book Sentient and Us)
Featuring author Tony Hughes in conversation with venture capitalist Craig Vachon, the webinar moved beyond the usual AI buzzwords and hype. Instead, it examined AI as a civilization-shaping force, one that is already changing work, education, ethics, security, and the future of human agency.
Key Topics
AI Success Is Not Just About Building More Power
One of the strongest themes in the webinar was that success with AI should not be measured only by speed, adoption, or commercial growth. Hughes emphasized that real success may mean avoiding large-scale harm. That includes harm to employment, truth, social trust, and even human safety.
This is a crucial reframing. In a world obsessed with innovation, the webinar argued that restraint, responsibility, and foresight may matter just as much as technical breakthroughs.
AI Is Reshaping Both Mental and Physical Work
The conversation made clear that AI is no longer confined to automating routine office tasks. It is increasingly affecting knowledge work such as coding, research, writing, and analysis. At the same time, advances in robotics suggest that physical labor will also face major change.
This dual disruption makes the current moment different from earlier technological revolutions. AI is beginning to challenge both cognitive and manual roles, forcing society to rethink not only jobs, but how people prepare for a changing economy.
AI Can Also Be a Powerful Tool for Entrepreneurs
While the webinar raised serious concerns, it also pointed to real opportunity. Both speakers noted that AI can reduce the cost and complexity of starting something new. Entrepreneurs can now use AI to conduct research, create prototypes, automate tasks, and build businesses faster with fewer resources.
For students, founders, and creative problem-solvers, this could be a remarkable opening. AI may displace some traditional roles, but it can also empower a new generation of builders who know how to use these tools wisely.
Values and Alignment Matter More Than Ever
Another major takeaway was that intelligence alone is not enough. The deeper issue is alignment: what goals, values, and constraints guide increasingly autonomous systems?
The webinar stressed that safety frameworks, ethical guardrails, and human oversight are not optional extras. They are essential. If AI becomes more powerful without becoming more aligned with human values, the consequences could be severe.
Human Strengths Become More Valuable in an AI World
As AI-generated content spreads and misinformation becomes easier to produce, the webinar highlighted the growing importance of distinctly human qualities. Judgment, trust-building, empathy, storytelling, and the ability to interpret nuance will remain critical.
In other words, the rise of AI does not reduce the value of human capabilities. It raises the premium on them.
Why You Should Watch the Recording
Perhaps the most practical conclusion from the webinar was that the future will belong to people who can work with AI without surrendering their humanity. Curiosity, critical thinking, ethics, and adaptability will all become more important in the years ahead.
The recorded webinar is well worth your time. It offers a serious, accessible, and timely discussion about the risks and possibilities of AI, and it is exactly the kind of conversation that leaders, educators, entrepreneurs, and citizens should be engaging with right now.
Questions from attendees
Given that AI has already shown that it can master language and math better than humans, isn’t it an opportunity now for humanity to focus on those intelligences that AI cannot experience like moral intelligence, emotional intelligence, trust, love and other deeper ontological domains?
GCV: Hell yes. Plus art. Solution prioritization. Iteration.
Tony: Yes. Humans are uniquely capable of fun and humor, story-telling, belief and trust, holistic problem-solving, managing ambiguity, real empathy and insight, future-state vision emotional connection, intuitive orchestration, imagination & curiosity, creativity and innovation, building the business case, and navigating complex politics and securing consensus. Self-sacrificial love is uniquely human and a transcendent value. I explore this in the SENTIENTbook (www.SENTIENTbook.com)
War propaganda will be even more sophisticated and convincing, despite being very wrong, with the use of AI. Do you agree?
GCV: yes. And dynamic hyper-personalized persuasion scares the fuck out of me combined with data from social media
Tony: Yes. Truth is the first casualty of war and with propaganda and manipulation accepted strategies of conflict. AI and deep-fake videos, and the ability to ‘swarm the zone’ with misinformation is an increasing concern. Atomisation and personalization means individual manipulation can be achieved at scale as algorithms and 1:1 content keeps ‘nudging’ the human targets to shape opinions and decisions. We will all need to focus on people we trust for information on which we can depend.
Since it seems impossible to throttle the development of AI should we start developing anti AI tech? Ways to stop the bad unintended consequences.
GCV: A hacker group I am aware of softens the political guard rails of Qwen and Deepseek regularly.
Tony: The only thing that can effectively counter AI, is other AI that operates with ‘good intent’. We won’t be able to simply unplug rogue AI systems because the intelligence architecture will be distributed and encrypted. I explore this in the SENTIENTbook (www.SENTIENTbook.com)
Can you expand/explain why quantum physicists/scientists believe we are living in a simulation?
GCV: No. Can’t explain. And I don’t think it changes anything for me if it is true.
Tony: In my research for writing the SENTIENT book, I came to understand that many AI engineers and leaders, and many quantum physicists/scientists believe in ‘simulation theory’. For AI researchers, this is understandable as they run simulations all the time with their systems… it is natural to wonder if we ourselves are in a simulation… maybe an ‘ancestor simulation’. Quantum physics and string theory contain ‘spooky’ metaphysical theories and observations (matter being interconnected across space/time, and able to exist simultaneously in different states, and mere observation bringing about a changed state of existence. Similar to ‘frustum culling’ (the computer game design principle of renderingobjects only when the player looks into a space (bring something into existence as the player requires / on demand). Also, the more we understand physics, the more unlikely it seems that we are here by random chase. If a person does not want to believe in a Creator/God, then believing in us being part of a simulation is an alternative (non-theistic) belief system.There is a lot more to this and I explain various aspects within the SENTIENT book.
Do you believe that we are alone in the universe/the existence of intelligent life outside of earth and that AI is like an alien invasion and the creation of an alien species?
GCV: no. AI is entirely human derived. (I’ve worked too hard for it to be someone else’s work product.)
Tony: It is unlikely that Earth is the only host system of biological intelligence in the universe. It is possible that aliens may have seeded life here and Richard Dawkins (Professor of Biology and famous atheist) thinks that to be the most plausible explanation of our existence. AI is a human invention, not from Aliens… but AI itself is an emergent ‘alien intelligence’ that mirrors us and is now evolving in ways we do not fully understand. When AI evolves to AGI and ASI, Machine intelligence may be regarded as a ‘digital species’
What do you think of the New Sapience approach? How does the upcoming Quantum processing units QPUs fit into this?
GCV: I invested in quantum compute in 2012. Just like it was in 2012, quantum compute is still 15 years away. I think we’re closer to commercial fusion.
From an economics perspective...how do you see the nation(s) supporting the previously employed workforce?
GCV: if it is the current regime, they won’t.
Tony: The idea of a universal income for citizens, funded by a tech-automation, tax is not realistic. Redistribution of wealth by governments always fails as a system. We need to redefine ‘work’ and ‘value’ to create the future we want.
Do you think the internet made humanity better?
GCV: yes. But like any other tool, it can be used for the betterment of humanity or not.
Tony: Yes, and AI will also improve humanity in many areas such as medicine, physics, and science. But AI in the form of ‘companions’ will do significant damage. Machine intelligence is becoming far more than a ‘tool’, to be goal seeking entities that recursively self-improve and evolve.
Little has been said about AI as a new species rather than a technology and how will we partner with it to co-evolve ourselves and it as we both encounter the new, fast emerging reality. What do Craig and Tony think off that?
GCV: If it gains sentience, I’ll be sure to ask her.
Tony: This is what I seek to address in the SENTIENT book. Let me know what you think when you read it :)
Do you support banning AI from emulating humans or creating realistic images of humans?
GCV: I make hyper-personalized digital twins of humans that save their lives. It’s probably the best use of AI to date.
Tony: I agree with Craig. A digital twin is ground-breaking for medical health. But AI should not impersonate a human. The Uncanny Valley problem is being overcome very fast with digital fakes that are already realistic. People are losing trust in content and platforms as fakery and propaganda increases.
Contra my dear friend Craig, the discipline of long division, for example, is necessary for complex critical thinking, creativity, and character development (values) which are the human traits we need to maintain in the current and future context. Right?
GCV: I know I can, but rely on a silicon chip as my brain wants to focus on larger challenges. Jmho.
Tony: AI is making the vast majority of people dumber and susceptible to false information and manipulation. Knowing ‘why’ and ‘how’ is as important as knowing the ‘what’ or answer.