Claude can now control your computer - Sync #490
I hope you enjoy this free post. If you do, please like ❤️ or share it, for example by forwarding this email to a friend or colleague. Writing this post took around eight hours to write. Liking or sharing it takes less than eight seconds and makes a huge difference. Thank you! Claude can now control your computer - Sync #490Plus: OpenAI plans to release Orion by December; DeepMind open-sources SynthID-Text; Tesla has been secretly testing Robotaxi; US startup that screen embryos for IQ; Casio's robot pet; and more!Hello and welcome to Sync #490! It’s been a big week for Anthropic. The AI company released two new models and a very interesting tool that allows an AI agent take control over user’s computer. We will take a closer look at both things in the editorial section of this week’s issue of Sync. Elsewhere in AI, rumours have emerged that OpenAI is planning to release a new model, codenamed Orion, by December. Meanwhile, Google DeepMind has open-sourced SynthID-Text to help watermark and detect AI-generated text, Perplexity is looking to fundraise at an $8B valuation, and Apple employees believe the upcoming Apple Intelligence is two years behind its competitors. In robotics, Tesla has been secretly testing Robotaxi service for a most of the year, a humanoid robot gets up off the ground like no human would and Casio thinks an AI-powered robotic furball will replace your pet. Also in this issue of Sync is included a story about a US startup that charges couples for screening embryos for IQ and other traits, scientists created a smart insulin that can automatically switch on and off depending on glucose levels in the blood, and what our posthuman descendants might look like. Enjoy! Claude can now control your computerThis week, Anthropic dropped two new things. The first thing are two new models—the upgraded Claude 3.5 Sonnet and a brand new Claude 3.5 Haiku. According to benchmarks provided by Anthropic, the new Claude 3.5 Sonnet is even better than already impressive previous version of Claude 3.5 Sonnet. Specifically, Anthropic highlighted how good the new model is in coding tasks. In coding-oriented SWE-bench Verified benchmarks, its score went from 33.4% to 49.0%, beating all publically available models, including OpenAI’s o1 model. The new Claude 3.5 Sonnet also reports better scores in agentic tasks and tool use. Claude 3.5 Haiku, meanwhile, offers speed and affordability. Anthropic says new Haiku surpasses Claude 3 Opus, the largest model in the previous generation of Claude models, which says a lot how the performance of large language models has improved since Claude 3 was released in March 2024. In benchmark results published by Anthropic, Claude 3.5 Haiku matches or exceeds GPT-4o mini, one of its main competitors. However, both Claude 3.5 Haiku and GPT-4o mini fall short of Google’s Gemini 1.5 Flash. The new Claude 3.5 Sonnet is available for all users for the same price and speed as its predecessor. Claude 3.5 Haiku, meanwhile, will be made available later this month through Anthropic API, Amazon Bedrock and Google Cloud’s Vertex AI. Initially, Claude 3.5 Haiku will accept only text inputs. Anthropic mentioned that Claude 3.5 Haiku will be able to accept images as input but the company did not specify when it will happen. The second, more interesting thing Anthropic announced is Computer use. Essentially, Computer use allows Claude to see the user’s screen and control it—it can move mouse, click buttons on the screen, fill in and submit forms, open apps and webpages. The demo video Anthropic prepared very well illustrates how Computer use works. As Anthropic writes, the purpose of Computer use is to provide a general tool to automate repetive tasks. Anthropic also sees possible applications in software development, research or orchestrating tasks. The Computer use is currently in beta and can be accessed through Anthropic API, Amazon Bedrock and Google Cloud’s Vertex AI. After seeing how Computer use looks like, you might see some similarities with Microsoft Recall, a new feature coming to Windows that records the screen and lets AI see what the user is doing and take some actions. However, Microsoft Recall has faced opposition, with security experts raising concerns about the privacy and security of this tool. In response, Microsoft postponed the release but still intends to proceed with it. Apple is proposing something similar with Apple Intelligence, where the new Siri can also view the screen and perform actions. Reportedly, Google is also working on a similar feature that may be unveiled in December. The difference between Anthropic’s Computer Use and that of others is that Anthropic offers Computer Use as an API. Microsoft, Apple, and Google are planning to integrate their equivalent of Computer Use directly into their products (Windows, iOS/macOS, and Chrome/Android, respectively), tailoring it more specifically for the user. Anthropic, meanwhile, opens Computer Use for developers to incorporate into their apps and services. Anthropic reports that companies such as Asana, Canva, Cognition, DoorDash, Replit, and The Browser Company have already begun using Computer Use to automate tasks that require dozens, and sometimes even hundreds, of steps to complete. Once again, Anthropic has introduced an interesting idea to the AI industry. They previously did this with Artifacts, which made interacting with and guiding AI chatbots much easier. Artifacts was such a good idea that OpenAI replicated it with Canvas and I wouldn’t be surprised if OpenAI releases its own version of Computer Use in a few weeks or months. Now it is time for developers to see what they can do with Anthropic’s new models and with Computer use. If you enjoy this post, please click the ❤️ button or share it. Do you like my work? Consider becoming a paying subscriber to support it For those who prefer to make a one-off donation, you can 'buy me a coffee' via Ko-fi. Every coffee bought is a generous support towards the work put into this newsletter. Your support, in any form, is deeply appreciated and goes a long way in keeping this newsletter alive and thriving. 🦾 More than a humanA Neuralink Rival Says Its Eye Implant Restored Vision in Blind People US startup charging couples to ‘screen embryos for IQ’ 🔮 Future visions▶️ Posthuman Pathways: Strange And Awesome Destinations On Humanity's Future Journeys (42:24) In this video, Isaac Arthur imagines how humanity might look centuries, millennia, or even millions of years into the future. He explores possible paths for posthuman transformation, such as body augmentation, brain enhancements, virtual minds, and hive or distributed consciousness. These paths could lead to beings that resemble us but have perfected bodies or cybernetic augmentations, as well as more esoteric concepts like planet-sized consciousnesses and hybrid biological-machine entities, far beyond recognisable human forms. Isaac also examines how diverging from human roots could impact identity, consciousness, and human values. 🧠 Artificial IntelligenceOpenAI plans to release its next big AI model by December Perplexity is reportedly looking to fundraise at an $8B valuation Google shifts Gemini app team to DeepMind Google Is Now Watermarking Its AI-Generated Text Adobe starts roll-out of AI video tools, challenging OpenAI and Meta Lawsuit claims Character.AI is responsible for teen's suicide Apple internally believes that it’s at least two years behind in AI development DeepMind and BioNTech Bet AI Lab Assistants Will Accelerate Science If you're enjoying the insights and perspectives shared in the Humanity Redefined newsletter, why not spread the word? 🤖 RoboticsTesla has been testing a robotaxi service in the Bay Area for most of the year Casio thinks an AI-powered furball can replace your pet Casio, a Japanese electronics company best known for its watches and calculators, is releasing a robotic pet called Moflin. The robot resembles a small, furry creature like a hamster or earless rabbit and is designed to form emotional bonds with its owner by acting cute and responding positively to attention, and negatively to neglect. Moflin is available for pre-order in Japan, with a release date set for November 7th and a price tag of about $400. ▶️ It seems GR-2 has found its next dream—becoming a bodybuilder! (1:11) Another week, another video of a humanoid robot. This time, it’s from Fourier, showcasing how their humanoid robot, GR-2, gets up off the ground in a way no human would. ▶️ Swiss-Mile Robot vs. Employees (1:32) Engineers from Swiss-Mile asked a simple question: who is faster—them or their four-legged robot with wheels? The result—only one human was faster than the robot, and that human was the world champion in high-speed urban orienteering. 🧬 BiotechnologyAI has dreamt up a blizzard of new proteins. Do any of them actually work? ‘Smart’ insulin prevents diabetic highs — and deadly lows Thanks for reading. If you enjoyed this post, please click the ❤️ button or share it. Humanity Redefined sheds light on the bleeding edge of technology and how advancements in AI, robotics, and biotech can usher in abundance, expand humanity's horizons, and redefine what it means to be human. A big thank you to my paid subscribers, to my Patrons: whmr, Florian, dux, Eric, Preppikoma and Andrew, and to everyone who supports my work on Ko-Fi. Thank you for the support! My DMs are open to all subscribers. Feel free to drop me a message, share feedback, or just say "hi!" |
Older messages
State of AI Report 2024 - Sync #489
Sunday, October 20, 2024
Plus: The New York Times warns Perplexity; have we reached peak human lifespan; tech giants tap nuclear power for AI; OpenAI projects billions in losses while Nvidia's stock reaches a new high ͏ ͏
Machine learning wins two Nobel Prizes - Sync #488
Sunday, October 20, 2024
Plus: Tesla reveals Cybercab; Meta Movie Gen; Nobel Prize for microRNA; how a racist deepfake divided a community; how the semiconductor industry actually works; and more! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
OpenAI raises over $6.6 billion - Sync #487
Sunday, October 6, 2024
Plus: SB 1047 has been vetoed; a new humanoid robot has been revealed; the dark side of AI voice cloning; a new episode in the fight over the CRISPR patent; and more! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Meta's new empire: VR, AR and AI - Sync #486
Saturday, September 28, 2024
Plus: Mira Murati leaves OpenAI; Microsoft to revive a nuclear plant for its AI data centre; bioengineered trees that capture more carbon; stem cell therapy for diabetes; and more! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
From Oil to AI: The Middle East's Rise as a New AI and Tech Hub - Sync #485
Sunday, September 22, 2024
Plus: Google to flag AI-generated images; new AI laws in California; Cruise is back in Bay Area; drones to fly between hospitals in London; 23andMe independent board directors resigns; and more! ͏ ͏ ͏
You Might Also Like
Corporate Casserole 🥘
Monday, November 25, 2024
How marketing and lobbying inspired Thanksgiving traditions. Here's a version for your browser. Hunting for the end of the long tail • November 24, 2024 Hey all, Ernie here with a classic
WP Weekly 221 - Bluesky - WP Assets on CDN, Limit Font Subsets, ACF Pro Now
Monday, November 25, 2024
Read on Website WP Weekly 221 / Bluesky Have you joined Bluesky, like many other WordPress users, a new place for an online social presence? Also in this issue: CrawlWP, Asset Management Framework,
🤳🏻 We Need More High-End Small Phones — Linux Terminal Setup Tips
Sunday, November 24, 2024
Also: Why I Switched From Google Maps to Apple Maps, and More! How-To Geek Logo November 24, 2024 Did You Know Medieval moats didn't just protect castles from invaders approaching over land, but
JSK Daily for Nov 24, 2024
Sunday, November 24, 2024
JSK Daily for Nov 24, 2024 View this email in your browser A community curated daily e-mail of JavaScript news JavaScript Certification Black Friday Offer – Up to 54% Off! Certificates.dev, the trusted
OpenAI's turbulent early years - Sync #494
Sunday, November 24, 2024
Plus: Anthropic and xAI raise billions of dollars; can a fluffy robot replace a living pet; Chinese reasoning model DeepSeek R1; robot-dog runs full marathon; a $12000 surgery to change eye colour ͏ ͏
Daily Coding Problem: Problem #1618 [Easy]
Sunday, November 24, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Zillow. Let's define a "sevenish" number to be one which is either a power
PD#602 How Netflix Built Self-Healing System to Survive Concurrency Bug
Sunday, November 24, 2024
CPUs were dying, the bug was temporarily un-fixable, and they had no viable path forward
RD#602 What are React Portals?
Sunday, November 24, 2024
A powerful feature that allows rendering components outside their parent component's DOM hierarchy
C#533 What's new in C# 13
Sunday, November 24, 2024
Params collections support, a new Lock type and others
⚙️ Smaller but deeper: Writer’s secret weapon to better AI
Sunday, November 24, 2024
November 24, 2024 | Read Online Ian Krietzberg Good morning. I sat down recently with Waseem Alshikh, the co-founder and CTO of enterprise AI firm Writer. Writer recently made waves with the release of