AI can use your computer
In the screen capture below, you can see how Claude AI can steer your computer per mouse and keyboard. ???
Now, there are no limits. AI can do anything you can! Not quite yet, but it’ll come.
Also, spend another minute to see Perplexity AI’s new reasoning feature.
We’re using an AI tool that creates how-to videos, so we don’t repeat the same thing over and over (carefully selected sponsor)
Your team + this AI video tool = creating how-to videos once and for all
No more unnecessary meetings, no more wasting time, no more low-engagement training content.
Just, add the extension, create a free account, record and the AI will: generate a step-by-step storyline, include highlights, add voiceover, produce a ready to share video.
Computer Use - The breakthrough feature
Anthropic has released a new feature called computer use. It is a breakthrough feature because their top model can now use your computer’s mouse and keyboard to work with your computer - as if it is you.
Currently, it is still a bit buggy, but we know how AI gets exponentially better.
In the following video, I show some of its capabilities and how to set it up.
Ok, that was me using the pre-build demo of Anthropic. They use a Docker environment to provide a save way demoing its capabilities.
Here are two more examples from the team.
1) Planning out a trip + scheduling
2) Computer use for coding
Why is it a breakthrough feature?
Now, there are no limits for AI to work on your behalf.
In addition to their tool use feature, which is for calling APIs to perform tasks like calling SLMs (small language models) to run a sub-task, it can now use your mouse and keyboard to accomplish anything you would be able to - except it has vast knowledge.
Implement it yourself! With AI at hand, it is relatively easy. I certainly will.
From Claude’s documentation:
领英推荐
??? If you have built something nice, I happy to feature it in the newsletter.
Oh, and also, as a developer, I agree:
Would you be interested in a premium version of this newsletter?
No ads, and more in-depth content that you can co-shape.
Perplexity AI has now reasoning models in the backend to answer more complex tasks
?
It’s time to let AI create how-to videos for your team
?
That’s a wrap! I hope you enjoyed it.
Martin
Hey Martin Musiol ich finde deine Postings und überhaupt die Arbeit von Generative AI total wertvoll. Hab schon mehrere KI-Tools in Nutzung, weil ich sie bei euch gespottet habe. Wenn ich mich richtig erinnere, warst du schon vor 10 Jahren an der Leuphana an dem Thema KI interessiert. Was für eine tolle Entwicklung, freut mich Mega für dich (und uns, die tollen Content bekommen) ?? Macht weiter so!