Claude can now control your computer - Sync #490
I hope you enjoy this free post. If you do, please like ❤️ or share it, for example by forwarding this email to a friend or colleague. Writing this post took around eight hours to write. Liking or sharing it takes less than eight seconds and makes a huge difference. Thank you! Claude can now control your computer - Sync #490Plus: OpenAI plans to release Orion by December; DeepMind open-sources SynthID-Text; Tesla has been secretly testing Robotaxi; US startup that screen embryos for IQ; Casio's robot pet; and more!Hello and welcome to Sync #490! It’s been a big week for Anthropic. The AI company released two new models and a very interesting tool that allows an AI agent take control over user’s computer. We will take a closer look at both things in the editorial section of this week’s issue of Sync. Elsewhere in AI, rumours have emerged that OpenAI is planning to release a new model, codenamed Orion, by December. Meanwhile, Google DeepMind has open-sourced SynthID-Text to help watermark and detect AI-generated text, Perplexity is looking to fundraise at an $8B valuation, and Apple employees believe the upcoming Apple Intelligence is two years behind its competitors. In robotics, Tesla has been secretly testing Robotaxi service for a most of the year, a humanoid robot gets up off the ground like no human would and Casio thinks an AI-powered robotic furball will replace your pet. Also in this issue of Sync is included a story about a US startup that charges couples for screening embryos for IQ and other traits, scientists created a smart insulin that can automatically switch on and off depending on glucose levels in the blood, and what our posthuman descendants might look like. Enjoy! Claude can now control your computerThis week, Anthropic dropped two new things. The first thing are two new models—the upgraded Claude 3.5 Sonnet and a brand new Claude 3.5 Haiku. According to benchmarks provided by Anthropic, the new Claude 3.5 Sonnet is even better than already impressive previous version of Claude 3.5 Sonnet. Specifically, Anthropic highlighted how good the new model is in coding tasks. In coding-oriented SWE-bench Verified benchmarks, its score went from 33.4% to 49.0%, beating all publically available models, including OpenAI’s o1 model. The new Claude 3.5 Sonnet also reports better scores in agentic tasks and tool use. Claude 3.5 Haiku, meanwhile, offers speed and affordability. Anthropic says new Haiku surpasses Claude 3 Opus, the largest model in the previous generation of Claude models, which says a lot how the performance of large language models has improved since Claude 3 was released in March 2024. In benchmark results published by Anthropic, Claude 3.5 Haiku matches or exceeds GPT-4o mini, one of its main competitors. However, both Claude 3.5 Haiku and GPT-4o mini fall short of Google’s Gemini 1.5 Flash. The new Claude 3.5 Sonnet is available for all users for the same price and speed as its predecessor. Claude 3.5 Haiku, meanwhile, will be made available later this month through Anthropic API, Amazon Bedrock and Google Cloud’s Vertex AI. Initially, Claude 3.5 Haiku will accept only text inputs. Anthropic mentioned that Claude 3.5 Haiku will be able to accept images as input but the company did not specify when it will happen. The second, more interesting thing Anthropic announced is Computer use. Essentially, Computer use allows Claude to see the user’s screen and control it—it can move mouse, click buttons on the screen, fill in and submit forms, open apps and webpages. The demo video Anthropic prepared very well illustrates how Computer use works. As Anthropic writes, the purpose of Computer use is to provide a general tool to automate repetive tasks. Anthropic also sees possible applications in software development, research or orchestrating tasks. The Computer use is currently in beta and can be accessed through Anthropic API, Amazon Bedrock and Google Cloud’s Vertex AI. After seeing how Computer use looks like, you might see some similarities with Microsoft Recall, a new feature coming to Windows that records the screen and lets AI see what the user is doing and take some actions. However, Microsoft Recall has faced opposition, with security experts raising concerns about the privacy and security of this tool. In response, Microsoft postponed the release but still intends to proceed with it. Apple is proposing something similar with Apple Intelligence, where the new Siri can also view the screen and perform actions. Reportedly, Google is also working on a similar feature that may be unveiled in December. The difference between Anthropic’s Computer Use and that of others is that Anthropic offers Computer Use as an API. Microsoft, Apple, and Google are planning to integrate their equivalent of Computer Use directly into their products (Windows, iOS/macOS, and Chrome/Android, respectively), tailoring it more specifically for the user. Anthropic, meanwhile, opens Computer Use for developers to incorporate into their apps and services. Anthropic reports that companies such as Asana, Canva, Cognition, DoorDash, Replit, and The Browser Company have already begun using Computer Use to automate tasks that require dozens, and sometimes even hundreds, of steps to complete. Once again, Anthropic has introduced an interesting idea to the AI industry. They previously did this with Artifacts, which made interacting with and guiding AI chatbots much easier. Artifacts was such a good idea that OpenAI replicated it with Canvas and I wouldn’t be surprised if OpenAI releases its own version of Computer Use in a few weeks or months. Now it is time for developers to see what they can do with Anthropic’s new models and with Computer use. If you enjoy this post, please click the ❤️ button or share it. Do you like my work? Consider becoming a paying subscriber to support it For those who prefer to make a one-off donation, you can 'buy me a coffee' via Ko-fi. Every coffee bought is a generous support towards the work put into this newsletter. Your support, in any form, is deeply appreciated and goes a long way in keeping this newsletter alive and thriving. 🦾 More than a humanA Neuralink Rival Says Its Eye Implant Restored Vision in Blind People US startup charging couples to ‘screen embryos for IQ’ 🔮 Future visions▶️ Posthuman Pathways: Strange And Awesome Destinations On Humanity's Future Journeys (42:24) In this video, Isaac Arthur imagines how humanity might look centuries, millennia, or even millions of years into the future. He explores possible paths for posthuman transformation, such as body augmentation, brain enhancements, virtual minds, and hive or distributed consciousness. These paths could lead to beings that resemble us but have perfected bodies or cybernetic augmentations, as well as more esoteric concepts like planet-sized consciousnesses and hybrid biological-machine entities, far beyond recognisable human forms. Isaac also examines how diverging from human roots could impact identity, consciousness, and human values. 🧠 Artificial IntelligenceOpenAI plans to release its next big AI model by December Perplexity is reportedly looking to fundraise at an $8B valuation Google shifts Gemini app team to DeepMind Google Is Now Watermarking Its AI-Generated Text Adobe starts roll-out of AI video tools, challenging OpenAI and Meta Lawsuit claims Character.AI is responsible for teen's suicide Apple internally believes that it’s at least two years behind in AI development DeepMind and BioNTech Bet AI Lab Assistants Will Accelerate Science If you're enjoying the insights and perspectives shared in the Humanity Redefined newsletter, why not spread the word? 🤖 RoboticsTesla has been testing a robotaxi service in the Bay Area for most of the year Casio thinks an AI-powered furball can replace your pet Casio, a Japanese electronics company best known for its watches and calculators, is releasing a robotic pet called Moflin. The robot resembles a small, furry creature like a hamster or earless rabbit and is designed to form emotional bonds with its owner by acting cute and responding positively to attention, and negatively to neglect. Moflin is available for pre-order in Japan, with a release date set for November 7th and a price tag of about $400. ▶️ It seems GR-2 has found its next dream—becoming a bodybuilder! (1:11) Another week, another video of a humanoid robot. This time, it’s from Fourier, showcasing how their humanoid robot, GR-2, gets up off the ground in a way no human would. ▶️ Swiss-Mile Robot vs. Employees (1:32) Engineers from Swiss-Mile asked a simple question: who is faster—them or their four-legged robot with wheels? The result—only one human was faster than the robot, and that human was the world champion in high-speed urban orienteering. 🧬 BiotechnologyAI has dreamt up a blizzard of new proteins. Do any of them actually work? ‘Smart’ insulin prevents diabetic highs — and deadly lows Thanks for reading. If you enjoyed this post, please click the ❤️ button or share it. Humanity Redefined sheds light on the bleeding edge of technology and how advancements in AI, robotics, and biotech can usher in abundance, expand humanity's horizons, and redefine what it means to be human. A big thank you to my paid subscribers, to my Patrons: whmr, Florian, dux, Eric, Preppikoma and Andrew, and to everyone who supports my work on Ko-Fi. Thank you for the support! My DMs are open to all subscribers. Feel free to drop me a message, share feedback, or just say "hi!" |
Older messages
State of AI Report 2024 - Sync #489
Sunday, October 20, 2024
Plus: The New York Times warns Perplexity; have we reached peak human lifespan; tech giants tap nuclear power for AI; OpenAI projects billions in losses while Nvidia's stock reaches a new high ͏ ͏
Machine learning wins two Nobel Prizes - Sync #488
Sunday, October 20, 2024
Plus: Tesla reveals Cybercab; Meta Movie Gen; Nobel Prize for microRNA; how a racist deepfake divided a community; how the semiconductor industry actually works; and more! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
OpenAI raises over $6.6 billion - Sync #487
Sunday, October 6, 2024
Plus: SB 1047 has been vetoed; a new humanoid robot has been revealed; the dark side of AI voice cloning; a new episode in the fight over the CRISPR patent; and more! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Meta's new empire: VR, AR and AI - Sync #486
Saturday, September 28, 2024
Plus: Mira Murati leaves OpenAI; Microsoft to revive a nuclear plant for its AI data centre; bioengineered trees that capture more carbon; stem cell therapy for diabetes; and more! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
From Oil to AI: The Middle East's Rise as a New AI and Tech Hub - Sync #485
Sunday, September 22, 2024
Plus: Google to flag AI-generated images; new AI laws in California; Cruise is back in Bay Area; drones to fly between hospitals in London; 23andMe independent board directors resigns; and more! ͏ ͏ ͏
You Might Also Like
🔎 How to Search Reddit Like a Pro — 9 Reasons to Always Use Windows With a VPN
Tuesday, November 12, 2024
Also: Tips for Setting Up a Mobile VR Office, and More! How-To Geek Logo November 12, 2024 Did You Know In the 2016 film Doctor Strange, the characters of both Doctor Strange and the villain Dormammu (
Web Scraping Tips, Python 3.13 Performance Boosts, Writing Interpreters & More
Tuesday, November 12, 2024
Introduction to Web Scraping With Python #655 – NOVEMBER 12, 2024 VIEW IN BROWSER The PyCoder's Weekly Logo Introduction to Web Scraping With Python In this video course, you'll learn all about
Daily Coding Problem: Problem #1606 [Easy]
Tuesday, November 12, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by PayPal. Given a binary tree, determine whether or not it is height-balanced. A height-
Charted | Breaking Down the U.S. Government's 2024 Fiscal Year 💰
Tuesday, November 12, 2024
Net interest payments cost the US government $882 billion in fiscal year 2024, the third-largest outlay in the final budget. View Online | Subscribe | Download Our App Presented by Hinrich Foundation
Spyglass Dispatch: AI's Independence Race • EU's Bad Meta Ads • AI Chip Shenanigans • Netflix Ads Religion
Tuesday, November 12, 2024
AI's Independence Race • EU's Bad Meta Ads • AI Chip Shenanigans • Netflix Ads Religion The Spyglass Dispatch is a free newsletter sent out daily on weekdays. Feel free to forward it on to
The Big T
Tuesday, November 12, 2024
Top Tech Content sent at Noon! How the world collects web data Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today, November 12, 2024? The HackerNoon
Deadline Extended: 2 Weeks Left to Compete for Over $7000 in the AI-chatbot Writing Contest🔥
Tuesday, November 12, 2024
Great news, newsletterest1 ! The submission deadline for the #ai-chatbot writing contest has been extended! You now have until November 21, 2024, to submit your unique AI chatbot ideas for a chance to
A very demure, very mindful issue
Tuesday, November 12, 2024
Plus a look at memory regions, Go's birthday, and we invent a brand new word. | #531 — November 12, 2024 Unsub | Web Version Together with Frontend Masters logo Go Weekly Happy Birthday, Go! Go
Visual Capitalist is revealing all of its biggest secrets... 📊
Tuesday, November 12, 2024
You can get in on our newest project if you act now. View Online | Subscribe | Download Our App We're revealing our biggest secrets... The question we get asked the most is: "How does Visual
🔓🐍 Unlock Your Python Potential with Instructor-Led Courses
Tuesday, November 12, 2024
Hey there, If you've been looking for a way to go beyond on-demand tutorials and really master Python, we've got something special for you... For the first time, Real Python is launching an