AIコーディングエージェントのTypeScriptコード編集能力を評価するための、手軽に再現可能なベンチマークプロジェクト「ts-bench」を公開しました。この記事では、筆者がなぜ ts-bench を作ったのか、今後どうしていきたいかについてお話しします。
GitHub - laiso/ts-benchContribute to laiso/ts-bench development by creating an account on GitHub.GitHublaiso
ts-benchの仕組み
ts-benchは、プログラミング学習プラットフォーム Exercism のTypeScript問題セットを利用します。各問題には、仕様を説明するドキュメント、エージェントが編集すべきソースコードのひな形、そして正解判定に使うテストコードが含まれています。
ベンチマークタスクは、各問題に対して以下の4つのステップを順番に実行します。
1. AIエージェントの実行: 問題の指示書をプロンプトとしてAIエージェントに渡し、ソースコードを編集させます。
2. テストファイルの復元
The attack we developed shows that traditional Web security assumptions don't hold for agentic AI, and that we need new security and privacy architectures for agentic browsing.
Self-Hosting Update: Migration to GitHub Container Registry - Announcements / Notices - Bitwarden Community Forums
Hi everyone, Due to recent Docker container limitations, we have migrated our images from Docker Hub to GitHub Container Registry. If you are deploying using methods that do not utilize the bitwarden.sh or bitwarden.ps1 scripts, please take a moment to update your image references to the new GitHub Container Registry URLs. Example E.g. ghcr.io/bitwarden/image_name:version Deployment Guides For general deployment guides, check out the following Help Center articles: Linux Windows Unified U...
Beyond Vibe Coding - A Guide To AI-Assisted Development
Transform your development workflow with AI. Learn from Google Chrome's Engineering Leader how to master AI-assisted development and build better software.
Advanced PostgreSQL Indexing: Multi-Key Queries and Performance Optimization
Postgres creates an execution plan for how to retrieve the data you're asking for in a query. The execution plan is based in part on statistics from your data and indexes it has available. Just the right index and a bit of query tuning can have a huge payoff in performance gains that your users will notice.
Hive Router: A High-Performance GraphQL Federation Gateway | Hive
Discover Hive Router, a new high-performance and open-source GraphQL Federation gateway. Built in Rust, it's a production-ready alternative to Apollo Router, offering superior GraphQL gateway performance and full Apollo Federation compatibility.
Apollo Federation Compatibility Audit: GraphQL Gateway Implementations
Audit of various GraphQL Gateways that support acting as an Apollo Federation Gateway. Check their compatibility with Apollo Federation and read detailed test reports.
Listen in on Jane Street’s Ron Minsky as he has conversations with engineers working on everything from clock synchronization to reliable multicast, build systems to reconfigurable hardware. Get a peek at how Jane Street approaches problems, and how those ideas relate to tech more broadly.