Anthropic Claude new model and coding agent launched
So after a very long wait, Anthropic has dropped a bomb of a LLM, an improved Claude 3.5 Sonnet i.e. Claude 3.7 Sonnet and the model is receiving rave reviews on the internet.The model is actually a beast on real-world problems according to Reddit reviews
And Redditors don’t lie
Claude 3.7 Sonnet key features
Claude 3.7 Sonnet introduces an integrated approach to reasoning, combining both quick responses and deep reflection into a unified model.
- Dual Functionality: It acts as both an ordinary LLM and a reasoning model, with the option to switch between regular and extended thinking modes for deeper reflection, improving performance in tasks like math, physics, coding, and instruction-following.
- Customizable Thinking Time: Users can control the thinking time via the API, specifying how long Claude should reflect before answering, balancing speed and answer quality.
- Focus on Real-World Tasks: The model prioritizes real-world applications over competitive math and computer science problems, better aligning with business needs.
- Advanced Coding Abilities: Claude 3.7 excels in coding tasks, outperforming other models in handling complex codebases, making full-stack updates, and building sophisticated applications. It’s especially noted for its precision in agent workflows and web app development.
- High-Quality Production Code: Its ability to generate production-ready code with superior design taste and fewer errors sets it apart in coding evaluations from companies like Cursor, Replit, and Canva.
Unfortunately, this is not open-sourced, similar to anthropic’s previous models
Benchmarks & Metrics
As you can see, the model has seen a huge jump in SWE-bench indicating high quality Software Development (coding) supremacy.
Not just that, the model looks great with tool usage, indicated by high TAU-bench score (A Benchmark for Tool-Agent-User Interaction in Real-World Domains).
Other important metrics can be explored below:
Not just Claude 3.7 Sonnet, Anthropic even released Claude Code as well
What is Claude Code?
Claude Code is an agentic coding tool developed by Anthropic, currently in beta as a research preview. It integrates directly with your development environment, helping you code faster through natural language commands without needing additional servers or complex setup.
Key Features:
Code Editing & Bug Fixing: Edit files and resolve bugs across your codebase.
Codebase Understanding: Answer questions about your code’s architecture and logic.
Executing Commands: Execute and fix tests, linting, and other commands.
Git Operations: Search through git history, resolve merge conflicts, and create commits and pull requests (PRs).
Real-time Actions: Claude operates directly in the terminal, exploring your codebase as needed, and performing real operations like editing files and creating commits.
Core Workflows:
Simple Commands: Ask questions about the codebase, create commits, and fix issues across multiple files with simple commands.
Git Workflow Automation: Automate Git tasks like committing changes, creating pull requests, rebasing, and resolving merge conflicts.
Code Debugging & Testing: Run tests, fix failures, and identify vulnerabilities.
Deeper Code Insights: Ask Claude to think deeply about complex tasks, such as architectural design or edge cases in code flows.
I’m yet to test the model and the tool but the first impressions are looking great
In conclusion, both Claude 3.7 Sonnet and Claude Code are groundbreaking advancements from Anthropic in the world of coding and LLMs. Claude 3.7 Sonnet sets a new standard with its dual functionality for quick responses and deep reflection, excelling in real-world tasks and offering unmatched performance in coding, web app development, and tool usage. Meanwhile, Claude Code, with its seamless integration into development environments, streamlines workflows through natural language commands, empowering developers to efficiently manage tasks like debugging, testing, and Git operations.
2025 is gonna be crazy
Claude 3.7 Sonnet and Claude Code: The best coding LLM is here was originally published in Data Science in your pocket on Medium, where people are continuing the conversation by highlighting and responding to this story.
