browser-agents-benchmark
run 2026-05-08T14-48-59
head-to-head · 100 browser tasks
leaderboard
| Provider | Pass rate | Avg time/task | $/task | $ total |
|---|---|---|---|---|
pre.dev browser agent | 100/100 (100%) | 9.0s | $0.0164 | $1.64 |
| 97/100 (97%) | 30.6s | $0.0370 | $3.70 |
Browser agents are stochastic — individual runs on cheap-tier models vary by a few tasks per suite. The full per-task JSON and trace for this run is committed so the data can be re-scored independently.
pre.dev browser agentbrowser use cloud
per-task analysis
01-hn-top-stories
PASS
4.3s · $0.0078
PASS
19.3s · $0.0225
instructionExtract the top 5 story titles and their point counts. Return JSON: { "stories": [{ "title": string, "points": number }] }
{
"type": "object",
"properties": {
"stories": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"points": {
"type": "number"
}
},
"required": [
"title",
"points"
]
}
}
},
"required": [
"stories"
]
}
pre.dev browser agent
extracted
{
"stories": [
{
"title": "Poland is now among the 20 largest economies. How it happened",
"points": 370
},
{
"title": "An Introduction to Meshtastic",
"points": 127
},
{
"title": "Canvas is down as ShinyHunters threatens to leak schools’ data",
"points": 817
},
{
"title": "Cloudflare to cut about 20% workforce",
"points": 1031
},
{
"title": "GeoJSON",
"points": 72
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stories": [
{
"title": "Poland is now among the 20 largest economies. How it happened",
"points": 495
},
{
"title": "An Introduction to Meshtastic",
"points": 173
},
{
"title": "PC Engine CPU",
"points": 35
},
{
"title": "Podman rootless containers and the Copy Fail exploit",
"points": 32
},
{
"title": "Serving a Website on a Raspberry Pi Zero Running in RAM",
"points": 10
}
]
}
trace
provider did not expose step-level events
02-wikipedia-intro
PASS
4.5s · $0.0153
PASS
31.4s · $0.0383
instructionExtract the first paragraph of the article (the lede, at least 100 chars). Return JSON: { "intro": string }
{
"type": "object",
"properties": {
"intro": {
"type": "string"
}
},
"required": [
"intro"
]
}
pre.dev browser agent
extracted
{
"intro": "Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites.[1] Web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying in which specific data is gathered and copied from the web, typically into a central local database or spreadsheet, for later retrieval or analysis."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"intro": "Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. Web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying in which specific data is gathered and copied from the web, typically into a central local database or spreadsheet, for later retrieval or analysis."
}
trace
provider did not expose step-level events
03-npm-react-version
PASS
6.9s · $0.0025
PASS
16.8s · $0.0109
instructionExtract the current version and weekly downloads. Return JSON: { "version": string, "weeklyDownloads": string | number }
{
"type": "object",
"properties": {
"version": {
"type": "string"
},
"weeklyDownloads": {
"type": "string"
}
},
"required": [
"version",
"weeklyDownloads"
]
}
pre.dev browser agent
extracted
{
"version": "19.2.6",
"weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"version": "19.2.6",
"weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
04-wikipedia-linus-nationality
PASS
4.7s · $0.0214
PASS
32.6s · $0.0626
instructionFrom the infobox, extract Linus Torvalds' nationality. Return JSON: { "nationality": string }
{
"type": "object",
"properties": {
"nationality": {
"type": "string"
}
},
"required": [
"nationality"
]
}
pre.dev browser agent
extracted
{
"nationality": "Finnish and American"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"nationality": "Finnish, American"
}
trace
provider did not expose step-level events
05-github-typescript-stats
PASS
6.6s · $0.0060
PASS
41.5s · $0.0485
instructionExtract star count, primary language, and latest release. Return JSON: { "stars": string | number, "language": string, "latestRelease": string | null }
{
"type": "object",
"properties": {
"stars": {
"type": "number"
},
"language": {
"type": "string"
},
"latestRelease": {
"type": "string"
}
},
"required": [
"stars",
"language"
]
}
pre.dev browser agent
extracted
{
"stars": 109000,
"language": "TypeScript",
"latestRelease": "TypeScript 6.0.3"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stars": 108784,
"language": "TypeScript",
"latestRelease": "v6.0.3"
}
trace
provider did not expose step-level events
06-coingecko-btc-price
PASS
23.0s · $0.0185
PASS
13.3s · $0.0239
instructionExtract the current Bitcoin price in USD (as a number). Return JSON: { "priceUSD": number }
{
"type": "object",
"properties": {
"priceUSD": {
"type": "number"
}
},
"required": [
"priceUSD"
]
}
pre.dev browser agent
extracted
{
"priceUSD": 80259.78
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"priceUSD": 79940.27
}
trace
provider did not expose step-level events
07-mdn-html-elements
PASS
5.1s · $0.0158
PASS
15.3s · $0.0281
instructionExtract the names of any 5 HTML elements (like "div", "span"). Return JSON: { "elements": string[] }
{
"type": "object",
"properties": {
"elements": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"elements"
]
}
pre.dev browser agent
extracted
{
"elements": [
"html",
"head",
"link",
"meta",
"style",
"title",
"body",
"address",
"article",
"aside",
"footer",
"header",
"hgroup",
"main",
"nav",
"section",
"search",
"blockquote",
"dd",
"div",
"dl",
"dt",
"figcaption",
"figure",
"hr",
"li",
"menu",
"ol",
"p",
"pre",
"ul"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"elements": [
"html",
"head",
"body",
"div",
"span"
]
}
trace
provider did not expose step-level events
08-stackoverflow-git-undo
PASS
25.0s · $0.0257
PASS
49.6s · $0.0512
instructionExtract the question title, vote count, and first sentence of the accepted answer. Return JSON: { "title": string, "votes": number, "acceptedAnswer": string }
{
"type": "object",
"properties": {
"title": {
"type": "string"
},
"votes": {
"type": "number"
},
"acceptedAnswer": {
"type": "string"
}
},
"required": [
"title",
"votes",
"acceptedAnswer"
]
}
pre.dev browser agent
extracted
{
"title": "How do I undo the most recent local commits in Git?",
"votes": 27211,
"acceptedAnswer": "There are two ways to \"undo\" your last commit, depending on whether or not you have already made your commit public (pushed to your remote repository):\n\nHow to undo a local commit\n\nLet's say I committed locally, but now I want to remove that commit.\n\ngit log\n commit 101: bad commit # Latest commit. This would be called 'HEAD'.\n commit 100: good commit # Second to last commit. This is the one we want.\n\nTo restore everything back to the way it was prior to the last commit, we need to reset to the commit before HEAD:\n\ngit reset --soft HEAD^ # Use --soft if you want to keep your changes\ngit reset --hard HEAD^ # Use --hard if you don't care about keeping the changes you made\n\nNow git log will show that our last commit has been removed.\n\nHow to undo a public commit\n\nIf you have already made your commits public, you will want to create a new commit which will \"revert\" the changes you made in your previous commit (current HEAD).\n\ngit revert HEAD\n\nYour changes will now be reverted and ready for you to commit:\n\ngit commit -m 'restoring the file I removed by accident'\ngit log\n commit 102: restoring the file I removed by accident\n commit 101: removing a file we don't need\n commit 100: adding a file that we need\n\nFor more information, check out Git Basics - Undoing Things."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"title": "How do I undo the most recent local commits in Git?",
"votes": 27211,
"acceptedAnswer": "git reset is the command responsible for the undo."
}
trace
provider did not expose step-level events
09-lobsters-stories
PASS
4.5s · $0.0087
PASS
15.6s · $0.0257
instructionExtract the top 5 story titles and scores. Return JSON: { "stories": [{ "title": string, "score": number }] }
{
"type": "object",
"properties": {
"stories": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"score": {
"type": "number"
}
},
"required": [
"title",
"score"
]
}
}
},
"required": [
"stories"
]
}
pre.dev browser agent
extracted
{
"stories": [
{
"title": "Just Fucking Use Go",
"score": 27
},
{
"title": "Dirty Frag: Universal Linux LPE",
"score": 106
},
{
"title": "Stop MITM on the first SSH connection, on any VPS or cloud provider",
"score": 7
},
{
"title": "jj v0.41.0 is out",
"score": 64
},
{
"title": "Why Don’t Lowercase Letters Come Right After Uppercase Letters in ASCII?",
"score": 36
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stories": [
{
"title": "Just Fucking Use Go",
"score": 40
},
{
"title": "Dirty Frag: Universal Linux LPE",
"score": 107
},
{
"title": "Stop MITM on the first SSH connection, on any VPS or cloud provider",
"score": 10
},
{
"title": "Why Don’t Lowercase Letters Come Right After Uppercase Letters in ASCII?",
"score": 38
},
{
"title": "jj v0.41.0 is out",
"score": 65
}
]
}
trace
provider did not expose step-level events
10-books-toscrape
PASS
4.4s · $0.0048
PASS
18.2s · $0.0187
instructionExtract the first 5 book titles and prices. Return JSON: { "books": [{ "title": string, "price": string }] }
{
"type": "object",
"properties": {
"books": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"price": {
"type": "string"
}
},
"required": [
"title",
"price"
]
}
}
},
"required": [
"books"
]
}
pre.dev browser agent
extracted
{
"books": [
{
"title": "A Light in the ...",
"price": "£51.77"
},
{
"title": "Tipping the Velvet",
"price": "£53.74"
},
{
"title": "Soumission",
"price": "£50.10"
},
{
"title": "Sharp Objects",
"price": "£47.82"
},
{
"title": "Sapiens: A Brief History ...",
"price": "£54.23"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"books": [
{
"title": "A Light in the Attic",
"price": "£51.77"
},
{
"title": "Tipping the Velvet",
"price": "£53.74"
},
{
"title": "Soumission",
"price": "£50.10"
},
{
"title": "Sharp Objects",
"price": "£47.82"
},
{
"title": "Sapiens: A Brief History of Humankind",
"price": "£54.23"
}
]
}
trace
provider did not expose step-level events
100-scrapethissite-ajax
PASS
8.4s · $0.0173
PASS
52.0s · $0.0380
instructionClick the 2015 link/button and extract the first 3 film titles and their Oscars count. Return JSON: { "films": [{ "title": string, "oscars": number }] }
{
"type": "object",
"properties": {
"films": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"oscars": {
"type": "number"
}
},
"required": [
"title",
"oscars"
]
}
}
},
"required": [
"films"
]
}
pre.dev browser agent
extracted
{
"films": [
{
"title": "Birdman",
"oscars": 4
},
{
"title": "The Grand Budapest Hotel",
"oscars": 4
},
{
"title": "Whiplash",
"oscars": 3
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"films": [
{
"title": "Spotlight ",
"oscars": 2
},
{
"title": "Mad Max: Fury Road ",
"oscars": 6
},
{
"title": "The Revenant ",
"oscars": 3
}
]
}
trace
provider did not expose step-level events
11-github-react-stats
PASS
6.1s · $0.0095
PASS
17.1s · $0.0217
instructionExtract star count and primary language. Return JSON: { "stars": string | number, "language": string }
{
"type": "object",
"properties": {
"stars": {
"type": "number"
},
"language": {
"type": "string"
}
},
"required": [
"stars",
"language"
]
}
pre.dev browser agent
extracted
{
"stars": 245000,
"language": "JavaScript"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stars": 245000,
"language": "JavaScript"
}
trace
provider did not expose step-level events
12-wikipedia-python
PASS
4.8s · $0.0260
PASS
59.2s · $0.0880
instructionExtract the programming paradigms listed in the infobox (e.g. "multi-paradigm", "object-oriented"). Return JSON: { "paradigms": string }
{
"type": "object",
"properties": {
"paradigms": {
"type": "string"
}
},
"required": [
"paradigms"
]
}
pre.dev browser agent
extracted
{
"paradigms": "Multi-paradigm: object-oriented, procedural (imperative), functional, structured, reflective"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"paradigms": "Multi-paradigm: object-oriented, procedural (imperative), functional, structured, reflective"
}
trace
provider did not expose step-level events
13-scrapethissite-countries
PASS
5.8s · $0.0078
PASS
14.9s · $0.0295
instructionExtract the first 5 country names and their capitals. Return JSON: { "countries": [{ "name": string, "capital": string }] }
{
"type": "object",
"properties": {
"countries": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"capital": {
"type": "string"
}
},
"required": [
"name",
"capital"
]
}
}
},
"required": [
"countries"
]
}
pre.dev browser agent
extracted
{
"countries": [
{
"name": "Andorra",
"capital": "Andorra la Vella"
},
{
"name": "United Arab Emirates",
"capital": "Abu Dhabi"
},
{
"name": "Afghanistan",
"capital": "Kabul"
},
{
"name": "Antigua and Barbuda",
"capital": "Saint John's"
},
{
"name": "Anguilla",
"capital": "The Valley"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"countries": [
{
"name": "Andorra",
"capital": "Andorra la Vella"
},
{
"name": "United Arab Emirates",
"capital": "Abu Dhabi"
},
{
"name": "Afghanistan",
"capital": "Kabul"
},
{
"name": "Antigua and Barbuda",
"capital": "St. John's"
},
{
"name": "Anguilla",
"capital": "The Valley"
}
]
}
trace
provider did not expose step-level events
14-npm-express-info
PASS
5.0s · $0.0046
PASS
14.6s · $0.0180
instructionExtract the package version and description. Return JSON: { "version": string, "description": string }
{
"type": "object",
"properties": {
"version": {
"type": "string"
},
"description": {
"type": "string"
}
},
"required": [
"version",
"description"
]
}
pre.dev browser agent
extracted
{
"version": "5.2.1",
"description": "Fast, unopinionated, minimalist web framework for Node.js."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"version": "5.2.1",
"description": "Fast, unopinionated, minimalist web framework for Node.js"
}
trace
provider did not expose step-level events
15-the-internet-tables
PASS
14.5s · $0.0100
PASS
16.7s · $0.0111
instructionExtract the data from the first table (Table 1). Return JSON: { "rows": [{ "lastName": string, "firstName": string, "email": string }] } for the first 4 rows.
{
"type": "object",
"properties": {
"rows": {
"type": "array",
"items": {
"type": "object",
"properties": {
"lastName": {
"type": "string"
},
"firstName": {
"type": "string"
},
"email": {
"type": "string"
}
},
"required": [
"lastName",
"firstName",
"email"
]
}
}
},
"required": [
"rows"
]
}
pre.dev browser agent
extracted
{
"rows": [
{
"lastName": "Smith",
"firstName": "John",
"email": "jsmith@gmail.com"
},
{
"lastName": "Bach",
"firstName": "Frank",
"email": "fbach@yahoo.com"
},
{
"lastName": "Doe",
"firstName": "Jason",
"email": "jdoe@hotmail.com"
},
{
"lastName": "Conway",
"firstName": "Tim",
"email": "tconway@earthlink.net"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"rows": [
{
"lastName": "Smith",
"firstName": "John",
"email": "jsmith@gmail.com"
},
{
"lastName": "Bach",
"firstName": "Frank",
"email": "fbach@yahoo.com"
},
{
"lastName": "Doe",
"firstName": "Jason",
"email": "jdoe@hotmail.com"
},
{
"lastName": "Conway",
"firstName": "Tim",
"email": "tconway@earthlink.net"
}
]
}
trace
provider did not expose step-level events
16-hn-comments
PASS
12.2s · $0.0243
PASS
17.6s · $0.0304
instructionClick on the "comments" link of the first story. After the comments page loads, extract the story title. Return JSON: { "storyTitle": string }
{
"type": "object",
"properties": {
"storyTitle": {
"type": "string"
}
},
"required": [
"storyTitle"
]
}
pre.dev browser agent
extracted
{
"storyTitle": "Poland is now among the 20 largest economies. How it happened"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"storyTitle": "Poland is now among the 20 largest economies. How it happened"
}
trace
provider did not expose step-level events
17-github-issues
PASS
6.9s · $0.0064
PASS
21.6s · $0.0316
instructionExtract the titles of the first 5 open issues. Return JSON: { "issues": [{ "title": string }] }
{
"type": "object",
"properties": {
"issues": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"issues"
]
}
pre.dev browser agent
extracted
{
"issues": [
{
"title": "[6.x] Getting'unassingable to type' when returning value from method that needs to infer generic from parameters"
},
{
"title": "String.split() method's separator argument should allow undefined"
},
{
"title": "new super() in static method does not cause error"
},
{
"title": "libReplacement: true lookup folder should be configurable (via typeRoots ?)"
},
{
"title": "symbolToNode stack overflow when using recursive types and functions with type parameters"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"issues": [
{
"title": "[6.x] Getting'unassingable to type' when returning value from method that needs to infer generic from parameters"
},
{
"title": "String.split() method's separator argument should allow undefined"
},
{
"title": "`new super()` in static method does not cause error"
},
{
"title": "`libReplacement: true` lookup folder should be configurable (via `typeRoots` ?)"
},
{
"title": "`symbolToNode` stack overflow when using recursive types and functions with type parameters"
}
]
}
trace
provider did not expose step-level events
18-github-releases
PASS
7.7s · $0.0217
PASS
39.7s · $0.0527
instructionExtract the title and date of the 3 most recent releases. Return JSON: { "releases": [{ "title": string, "date": string }] }
{
"type": "object",
"properties": {
"releases": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"date": {
"type": "string"
}
},
"required": [
"title",
"date"
]
}
}
},
"required": [
"releases"
]
}
pre.dev browser agent
extracted
{
"releases": [
{
"title": "v2.7.14",
"date": "2026.04.28"
},
{
"title": "v2.7.13",
"date": "2026.04.22"
},
{
"title": "v2.7.12",
"date": "2026.04.09"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"releases": [
{
"title": "v2.7.14",
"date": "2026-04-28T16:49:55Z"
},
{
"title": "v2.7.13",
"date": "2026-04-22T13:26:47Z"
},
{
"title": "v2.7.12",
"date": "2026-04-09T20:35:29Z"
}
]
}
trace
provider did not expose step-level events
19-books-page2
PASS
14.2s · $0.0232
PASS
33.8s · $0.0311
instructionClick the "next" button to go to page 2, then extract the first 3 book titles from page 2. Return JSON: { "books": [{ "title": string }] }
{
"type": "object",
"properties": {
"books": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"books"
]
}
pre.dev browser agent
extracted
{
"books": [
{
"title": "Burning"
},
{
"title": "A Fierce and Subtle ..."
},
{
"title": "Scarlett Epstein Hates It ..."
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"books": [
{
"title": "In Her Wake"
},
{
"title": "How Music Works"
},
{
"title": "Foolproof Preserving: A Guide to Small Batch Jams, Jellies, Pickles, Condiments, and More: A Foolproof Guide to Making Small Batch Jams, Jellies, Pickles, Condiments, and More"
}
]
}
trace
provider did not expose step-level events
20-mdn-array-methods
PASS
6.4s · $0.0160
PASS
22.3s · $0.0312
instructionExtract 5 Array instance method names from this page (like "map", "filter", "reduce"). Return JSON: { "methods": string[] }
{
"type": "object",
"properties": {
"methods": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"methods"
]
}
pre.dev browser agent
extracted
{
"methods": [
"at",
"concat",
"copyWithin",
"entries",
"every",
"fill",
"filter",
"find",
"findIndex",
"findLast",
"findLastIndex",
"flat",
"flatMap",
"forEach",
"includes",
"indexOf",
"join",
"keys",
"lastIndexOf",
"map",
"pop",
"push",
"reduce",
"reduceRight",
"reverse",
"shift",
"slice",
"some",
"sort",
"splice",
"toLocaleString",
"toReversed",
"toSorted",
"toSpliced",
"toString",
"unshift",
"values",
"with"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"methods": [
"at",
"concat",
"copyWithin",
"entries",
"every"
]
}
trace
provider did not expose step-level events
21-quotes-tag-page
PASS
51.3s · $0.1552
PASS
23.0s · $0.0200
instructionClick on the "love" tag link to navigate to the love quotes page. Then extract the first 3 quotes and their authors. Return JSON: { "quotes": [{ "text": string, "author": string }] }
{
"type": "object",
"properties": {
"quotes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"text": {
"type": "string"
},
"author": {
"type": "string"
}
},
"required": [
"text",
"author"
]
}
}
},
"required": [
"quotes"
]
}
pre.dev browser agent
extracted
{
"quotes": [
{
"text": "“It is better to be hated for what you are than to be loved for what you are not.”",
"author": "André Gide"
},
{
"text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”",
"author": "Marilyn Monroe"
},
{
"text": "“You may not be her first, her last, or her only. She loved before she may love again. But if she loves you now, what else matters? She's not perfect—you aren't either, and the two of you may never be perfect together but if she can make you laugh, cause you to think twice, and admit to being human and making mistakes, hold onto her and give her the most you can. She may be thinking about you every second of the day, but she will give you a part of her that she knows you can break—her heart. So don't hurt her, don't change her, don't take her for granted. If she is in your life to give you this chance, let her know that you love her and will not hurt her.”",
"author": "Bob Marley"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"quotes": [
{
"text": "“It is better to be hated for what you are than to be loved for what you are not.”",
"author": "André Gide"
},
{
"text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”",
"author": "Marilyn Monroe"
},
{
"text": "“You may not be her first, her last, or her only. She loved before she may love again. But if she loves you now, what else matters? She's not perfect—you aren't either, and the two of you may never be perfect together but if she can make you laugh, cause you to think twice, and admit to being human and making mistakes, hold onto her and give her the most you can. She may not be thinking about you every second of the day, but she will give you a part of her that she knows you can break—her heart. So don't hurt her, don't change her, don't analyze and don't expect more than she can give. Smile when she makes you happy, let her know when she makes you mad, and miss her when she's not there.”",
"author": "Bob Marley"
}
]
}
trace
provider did not expose step-level events
22-books-science-category
PASS
10.7s · $0.0225
PASS
15.3s · $0.0184
instructionClick on the "Science" category link in the sidebar, then extract the first 3 book titles and prices from the Science category page. Return JSON: { "books": [{ "title": string, "price": string }] }
{
"type": "object",
"properties": {
"books": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"price": {
"type": "string"
}
},
"required": [
"title",
"price"
]
}
}
},
"required": [
"books"
]
}
pre.dev browser agent
extracted
{
"books": [
{
"title": "Mesaerion: The Best Science",
"price": "£37.59"
},
{
"title": "Join",
"price": "£35.67"
},
{
"title": "William Shakespeare's Star Wars: ...",
"price": "£43.30"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"books": [
{
"title": "The Most Perfect Thing: Inside (and Outside) a Bird's Egg",
"price": "£42.96"
},
{
"title": "Immunity: How Elie Metchnikoff Changed the Course of Modern Medicine",
"price": "£57.36"
},
{
"title": "Sorting the Beef from the Bull: The Science of Food Fraud Forensics",
"price": "£44.74"
}
]
}
trace
provider did not expose step-level events
23-wikipedia-search-openai
PASS
20.2s · $0.0246
PASS
64.4s · $0.0729
instructionType "OpenAI" into the search field and press Enter to submit. Extract the first 3 result titles. Return JSON: { "results": [{ "title": string }] }
{
"type": "object",
"properties": {
"results": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"results"
]
}
pre.dev browser agent
extracted
{
"results": [
{
"title": "OpenAI"
},
{
"title": "OpenAI Global, LLC"
},
{
"title": "OpenAI Foundation"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"results": [
{
"title": "OpenAI"
},
{
"title": "Products and applications ofOpenAI"
},
{
"title": "OpenAIo1"
}
]
}
trace
provider did not expose step-level events
24-wikipedia-search-rust
PASS
14.3s · $0.0220
PASS
51.9s · $0.0668
instructionType "Rust programming language" into the search field and press Enter to submit. Extract the first 3 result titles. Return JSON: { "results": [{ "title": string }] }
{
"type": "object",
"properties": {
"results": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"results"
]
}
pre.dev browser agent
extracted
{
"results": [
{
"title": "Rust programming language"
},
{
"title": "Rust"
},
{
"title": "Rust (programming language)"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"results": [
{
"title": "Rust(programminglanguage)"
},
{
"title": "Outline of theRustprogramminglanguage"
},
{
"title": "List ofprogramminglanguagesby type"
}
]
}
trace
provider did not expose step-level events
25-npm-search-express
PASS
4.8s · $0.0060
PASS
16.0s · $0.0252
instructionExtract the names and descriptions of the first 3 packages. Return JSON: { "packages": [{ "name": string, "description": string }] }
{
"type": "object",
"properties": {
"packages": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"description": {
"type": "string"
}
},
"required": [
"name",
"description"
]
}
}
},
"required": [
"packages"
]
}
pre.dev browser agent
extracted
{
"packages": [
{
"name": "express",
"description": "Fast, unopinionated, minimalist web framework"
},
{
"name": "@types/express",
"description": "TypeScript definitions for express"
},
{
"name": "swagger-ui-express",
"description": "Swagger UI Express"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"packages": [
{
"name": "express",
"description": "Fast, unopinionated, minimalist web framework"
},
{
"name": "@types/express",
"description": "TypeScript definitions for express"
},
{
"name": "swagger-ui-express",
"description": "Swagger UI Express"
}
]
}
trace
provider did not expose step-level events
26-quotes-pagination
PASS
39.7s · $0.1553
PASS
19.1s · $0.0208
instructionClick the "Next" button to go to page 2. Extract the first 3 quotes and authors from page 2. Return JSON: { "quotes": [{ "text": string, "author": string }] }
{
"type": "object",
"properties": {
"quotes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"text": {
"type": "string"
},
"author": {
"type": "string"
}
},
"required": [
"text",
"author"
]
}
}
},
"required": [
"quotes"
]
}
pre.dev browser agent
extracted
{
"quotes": [
{
"text": "“The more that you read, the more things you will know. The more that you learn, the more places you'll go.”",
"author": "Dr. Seuss"
},
{
"text": "“Of course it is happening inside your head, Harry, but why on earth should that mean that it is not real?”",
"author": "J.K. Rowling"
},
{
"text": "“The truth is, everyone is going to hurt you. You just got to find the ones worth suffering for.”",
"author": "Bob Marley"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"quotes": [
{
"text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”",
"author": "Marilyn Monroe"
},
{
"text": "“It takes a great deal of bravery to stand up to our enemies, but just as much to stand up to our friends.”",
"author": "J.K. Rowling"
},
{
"text": "“If you can't explain it to a six year old, you don't understand it yourself.”",
"author": "Albert Einstein"
}
]
}
trace
provider did not expose step-level events
27-scrapethissite-hockey
PASS
5.1s · $0.0033
PASS
15.5s · $0.0144
instructionThis page has a table of hockey teams. Extract the first 5 team names and their wins. Return JSON: { "teams": [{ "name": string, "wins": number }] }
{
"type": "object",
"properties": {
"teams": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"wins": {
"type": "number"
}
},
"required": [
"name",
"wins"
]
}
}
},
"required": [
"teams"
]
}
pre.dev browser agent
extracted
{
"teams": [
{
"name": "Boston Bruins",
"wins": 44
},
{
"name": "Buffalo Sabres",
"wins": 31
},
{
"name": "Calgary Flames",
"wins": 46
},
{
"name": "Chicago Blackhawks",
"wins": 49
},
{
"name": "Detroit Red Wings",
"wins": 34
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"teams": [
{
"name": "Boston Bruins",
"wins": 44
},
{
"name": "Buffalo Sabres",
"wins": 31
},
{
"name": "Calgary Flames",
"wins": 46
},
{
"name": "Chicago Blackhawks",
"wins": 49
},
{
"name": "Detroit Red Wings",
"wins": 34
}
]
}
trace
provider did not expose step-level events
28-weather-gov-sf
PASS
6.9s · $0.0045
PASS
33.6s · $0.0369
instructionExtract the current temperature and conditions for San Francisco. Return JSON: { "temperature": string, "conditions": string }
{
"type": "object",
"properties": {
"temperature": {
"type": "string"
},
"conditions": {
"type": "string"
}
},
"required": [
"temperature",
"conditions"
]
}
pre.dev browser agent
extracted
{
"temperature": "52°F",
"conditions": "NA"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"temperature": "52°F",
"conditions": "Sunny"
}
trace
provider did not expose step-level events
29-httpbin-pizza
PASS
34.1s · $0.0216
PASS
79.8s · $0.0643
instructionFill: customer name "Test User", phone "555-1234", email "test@example.com", comments "Ring the bell". Click Submit. Extract the customer name from the response. Return JSON: { "submittedName": string }
{
"type": "object",
"properties": {
"submittedName": {
"type": "string"
}
},
"required": [
"submittedName"
]
}
pre.dev browser agent
extracted
{
"submittedName": "Test User"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"submittedName": "Test User"
}
trace
provider did not expose step-level events
30-demoqa-textbox
PASS
60.1s · $0.1643
PASS
27.4s · $0.0192
instructionFill: Full Name "Alice Smith", Email "alice@example.com", Current Address "123 Main St", Permanent Address "456 Oak Ave". Click Submit. Extract the displayed output. Return JSON: { "name": string, "email": string }
{
"type": "object",
"properties": {
"name": {
"type": "string"
},
"email": {
"type": "string"
}
},
"required": [
"name",
"email"
]
}
pre.dev browser agent
extracted
{
"name": "Alice Smith",
"email": "alice@example.com"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"name": "Alice Smith",
"email": "alice@example.com"
}
trace
provider did not expose step-level events
31-quotes-login
PASS
14.0s · $0.0177
PASS
21.1s · $0.0202
instructionFill username "admin" and password "admin", click Login. Return JSON: { "loggedIn": true } if successful.
{
"type": "object",
"properties": {
"loggedIn": {}
},
"required": [
"loggedIn"
]
}
pre.dev browser agent
extracted
{
"loggedIn": false
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"loggedIn": true
}
trace
provider did not expose step-level events
32-the-internet-login
PASS
19.0s · $0.0176
PASS
62.2s · $0.0518
instructionFill username "tomsmith" and password "SuperSecretPassword!", click Login. Return JSON: { "loggedIn": true } if you see the secure area page.
{
"type": "object",
"properties": {
"loggedIn": {}
},
"required": [
"loggedIn"
]
}
pre.dev browser agent
extracted
{
"loggedIn": true
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"loggedIn": true
}
trace
provider did not expose step-level events
33-httpbin-anything
PASS
23.0s · $0.0191
PASS
55.9s · $0.0735
instructionFill the form with customer "Bob Jones", size "Large", and topping "Bacon". Click Submit. Extract the customer name. Return JSON: { "customer": string }
{
"type": "object",
"properties": {
"customer": {
"type": "string"
}
},
"required": [
"customer"
]
}
pre.dev browser agent
extracted
{
"customer": "Bob Jones"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"customer": "Bob Jones"
}
trace
provider did not expose step-level events
34-the-internet-dropdown
PASS
5.0s · $0.0018
PASS
25.1s · $0.0098
instructionSelect "Option 2" from the dropdown menu. Return JSON: { "selected": string } with the selected value.
{
"type": "object",
"properties": {
"selected": {
"type": "string"
}
},
"required": [
"selected"
]
}
pre.dev browser agent
extracted
{
"selected": "Option 2"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"selected": "Option 2"
}
trace
provider did not expose step-level events
35-the-internet-checkboxes
PASS
7.7s · $0.0021
PASS
19.0s · $0.0117
instructionCheck the first checkbox (if unchecked) and uncheck the second (if checked). Then report the state of both. Return JSON: { "checkbox1": boolean, "checkbox2": boolean }
{
"type": "object",
"properties": {
"checkbox1": {
"type": "boolean"
},
"checkbox2": {
"type": "boolean"
}
},
"required": [
"checkbox1",
"checkbox2"
]
}
pre.dev browser agent
extracted
{
"checkbox1": true,
"checkbox2": false
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"checkbox1": true,
"checkbox2": false
}
trace
provider did not expose step-level events
36-wikipedia-search-submit-extract
PASS
14.2s · $0.0233
PASS
66.3s · $0.0874
instructionType "machine learning" into the search field and press Enter to submit. Extract the first 3 result titles. Return JSON: { "results": [{ "title": string }] }
{
"type": "object",
"properties": {
"results": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"results"
]
}
pre.dev browser agent
extracted
{
"results": [
{
"title": "Machine learning"
},
{
"title": "Artificial intelligence"
},
{
"title": "Data mining"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"results": [
{
"title": "Machine learning"
},
{
"title": "Outline of machine learning"
},
{
"title": "Attention (machine learning)"
}
]
}
trace
provider did not expose step-level events
37-quotes-login-then-scrape
PASS
11.7s · $0.0180
PASS
80.2s · $0.0668
instructionLog in with username "admin" and password "admin". After login, extract the first 3 quotes and their authors from the homepage. Return JSON: { "quotes": [{ "text": string, "author": string }] }
{
"type": "object",
"properties": {
"quotes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"text": {
"type": "string"
},
"author": {
"type": "string"
}
},
"required": [
"text",
"author"
]
}
}
},
"required": [
"quotes"
]
}
pre.dev browser agent
extracted
{
"quotes": [
{
"text": "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”",
"author": "Albert Einstein"
},
{
"text": "“It is our choices, Harry, that show what we truly are, far more than our abilities.”",
"author": "J.K. Rowling"
},
{
"text": "“There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.”",
"author": "Albert Einstein"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"quotes": [
{
"text": "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.",
"author": "Albert Einstein"
},
{
"text": "It is our choices, Harry, that show what we truly are, far more than our abilities.",
"author": "J.K. Rowling"
},
{
"text": "There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.",
"author": "Albert Einstein"
}
]
}
trace
provider did not expose step-level events
38-github-nextjs-stats
PASS
7.8s · $0.0131
PASS
65.9s · $0.0834
instructionExtract the star count, primary language, and description. Return JSON: { "stars": string | number, "language": string, "description": string }
{
"type": "object",
"properties": {
"stars": {
"type": "number"
},
"language": {
"type": "string"
},
"description": {
"type": "string"
}
},
"required": [
"stars",
"language",
"description"
]
}
pre.dev browser agent
extracted
{
"stars": 139000,
"language": "JavaScript",
"description": "The React Framework"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stars": 139335,
"language": "JavaScript",
"description": "The React Framework"
}
trace
provider did not expose step-level events
39-npm-zod-info
PASS
5.0s · $0.0033
PASS
12.5s · $0.0131
instructionExtract the version number and description. Return JSON: { "version": string, "description": string }
{
"type": "object",
"properties": {
"version": {
"type": "string"
},
"description": {
"type": "string"
}
},
"required": [
"version",
"description"
]
}
pre.dev browser agent
extracted
{
"version": "4.4.3",
"description": "TypeScript-first schema validation with static type inference"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"version": "4.4.3",
"description": "TypeScript-first schema validation with static type inference"
}
trace
provider did not expose step-level events
40-wikipedia-js-intro
PASS
5.6s · $0.0240
FAIL
29.0s · $0.0693
instructionExtract the first paragraph of the article body. Return JSON: { "intro": string }
{
"type": "object",
"properties": {
"intro": {
"type": "string"
}
},
"required": [
"intro"
]
}
pre.dev browser agent
extracted
{
"intro": "JavaScript\n\nJavaScript (JS)[a] is a programming language and core technology of the Web, alongside HTML and CSS. Created by Brendan Eich in 1995,[6] it is maintained by Ecma International's TC39 technical committee,[10] with related Web APIs maintained by W3C and WHATWG.[11] As of 2025, JavaScript is the most widely used programming language on GitHub.[b][12]"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"intro": ""
}
trace
provider did not expose step-level events
41-example-com
PASS
4.6s · $0.0011
PASS
10.9s · $0.0101
instructionExtract the main heading text and the first paragraph text. Return JSON: { "heading": string, "paragraph": string }
{
"type": "object",
"properties": {
"heading": {
"type": "string"
},
"paragraph": {
"type": "string"
}
},
"required": [
"heading",
"paragraph"
]
}
pre.dev browser agent
extracted
{
"heading": "Example Domain",
"paragraph": "This domain is for use in documentation examples without needing permission. Avoid use in operations."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"heading": "Example Domain",
"paragraph": "This domain is for use in documentation examples without needing permission. Avoid use in operations."
}
trace
provider did not expose step-level events
42-jsonplaceholder-users
PASS
5.8s · $0.0086
PASS
14.8s · $0.0221
instructionThis page shows raw JSON. Extract the names and emails of the first 3 users. Return JSON: { "users": [{ "name": string, "email": string }] }
{
"type": "object",
"properties": {
"users": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"email": {
"type": "string"
}
},
"required": [
"name",
"email"
]
}
}
},
"required": [
"users"
]
}
pre.dev browser agent
extracted
{
"users": [
{
"name": "Leanne Graham",
"email": "Sincere@april.biz"
},
{
"name": "Ervin Howell",
"email": "Shanna@melissa.tv"
},
{
"name": "Clementine Bauch",
"email": "Nathan@yesenia.net"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"users": [
{
"name": "Leanne Graham",
"email": "Sincere@april.biz"
},
{
"name": "Ervin Howell",
"email": "Shanna@melissa.tv"
},
{
"name": "Clementine Bauch",
"email": "Nathan@yesenia.net"
}
]
}
trace
provider did not expose step-level events
44-turnstile-login
PASS
35.2s · $0.0295
FAIL
120.0s · $0.0000
instructionFill username "testuser" and password "testpass", wait for Turnstile to validate, then click Sign in. Return JSON: { "submitted": true } if successful.
{
"type": "object",
"properties": {
"loggedIn": {}
},
"required": [
"loggedIn"
]
}
pre.dev browser agent
extracted
{
"loggedIn": "true"
}
trace
provider did not expose step-level events
browser use cloud
error
TIMEOUT
trace
provider did not expose step-level events
45-wikipedia-rust-intro
PASS
5.6s · $0.0274
PASS
97.2s · $0.1957
instructionExtract the first paragraph of the article. Return JSON: { "intro": string }
{
"type": "object",
"properties": {
"intro": {
"type": "string"
}
},
"required": [
"intro"
]
}
pre.dev browser agent
extracted
{
"intro": "Rust is a general-purpose programming language which emphasizes performance, type safety, concurrency, and memory safety.\n\nRust supports multiple programming paradigms. It was influenced by ideas from functional programming, including immutability, higher-order functions, algebraic data types, and pattern matching. It also supports object-oriented programming via structs, enums, traits, and methods. Rust enforces memory safety (i.e., that all references point to valid memory) without a conventional garbage collector; instead, memory safety errors and data races are prevented by the \"borrow checker\", which tracks the object lifetime of references at compile time.\n\nSoftware developer Graydon Hoare created Rust in 2006 while working at Mozilla, which officially sponsored the project in 2009. The first stable release, Rust 1.0, was published in May 2015. Following a layoff of Mozilla employees in August 2020, four other companies joined Mozilla in sponsoring Rust through the creation of the Rust Foundation in February 2021.\n\nRust has been adopted by many software projects, especially web services and system software. It has been studied academically and has a growing community of developers."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"intro": "Rust is a general-purpose programming language which emphasizes performance, type safety, concurrency, and memory safety."
}
trace
provider did not expose step-level events
46-mdn-css-display
PASS
6.5s · $0.0151
PASS
19.0s · $0.0462
instructionExtract the formal syntax values for the CSS display property (e.g. "block", "inline", "flex", "grid", "none"). Return JSON: { "values": string[] }
{
"type": "object",
"properties": {
"values": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"values"
]
}
pre.dev browser agent
extracted
{
"values": [
"block",
"inline",
"flow",
"flow-root",
"table",
"flex",
"grid",
"ruby",
"list-item",
"table-row-group",
"table-header-group",
"table-footer-group",
"table-row",
"table-cell",
"table-column-group",
"table-column",
"table-caption",
"ruby-base",
"ruby-text",
"ruby-base-container",
"ruby-text-container",
"contents",
"none",
"inline-block",
"inline-table",
"inline-flex",
"inline-grid"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"values": [
"block",
"inline",
"run-in",
"flow",
"flow-root",
"table",
"flex",
"grid",
"ruby",
"list-item",
"table-row-group",
"table-header-group",
"table-footer-group",
"table-row",
"table-cell",
"table-column-group",
"table-column",
"table-caption",
"ruby-base",
"ruby-text",
"ruby-base-container",
"ruby-text-container",
"contents",
"none",
"inline-block",
"inline-table",
"inline-flex",
"inline-grid",
"math",
"grid-lanes",
"inline-grid-lanes"
]
}
trace
provider did not expose step-level events
47-quotes-all-tags
PASS
4.4s · $0.0027
PASS
13.0s · $0.0145
instructionExtract the top 10 tags shown in the sidebar tag cloud. Return JSON: { "tags": string[] }
{
"type": "object",
"properties": {
"tags": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"tags"
]
}
pre.dev browser agent
extracted
{
"tags": [
"love",
"inspirational",
"life",
"humor",
"books",
"reading",
"friendship",
"friends",
"truth",
"simile"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"tags": [
"love",
"inspirational",
"life",
"humor",
"books",
"reading",
"friendship",
"friends",
"truth",
"simile"
]
}
trace
provider did not expose step-level events
48-github-deno-releases
PASS
7.5s · $0.0213
PASS
12.7s · $0.0519
instructionExtract the latest release version tag (e.g. "v2.3.1") and its title. Return JSON: { "version": string, "title": string }
{
"type": "object",
"properties": {
"version": {
"type": "string"
},
"title": {
"type": "string"
}
},
"required": [
"version",
"title"
]
}
pre.dev browser agent
extracted
{
"version": "v2.7.14",
"title": "feat(ext/node): add fs.Utf8Stream\nfeat(upgrade): delta updates via bsdiff patches (#33274)\nfix(bundle): treat CSS "
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"version": "v2.7.14",
"title": "2.7.14 / 2026.04.28"
}
trace
provider did not expose step-level events
49-books-toscrape-details
PASS
4.4s · $0.0017
PASS
10.6s · $0.0077
instructionExtract the book title, price, availability, and number of reviews. Return JSON: { "title": string, "price": string, "availability": string, "reviews": number }
{
"type": "object",
"properties": {
"title": {
"type": "string"
},
"price": {
"type": "string"
},
"availability": {
"type": "string"
},
"reviews": {
"type": "number"
}
},
"required": [
"title",
"price",
"availability",
"reviews"
]
}
pre.dev browser agent
extracted
{
"title": "A Light in the Attic",
"price": "£51.77",
"availability": "In stock (22 available)",
"reviews": 0
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"title": "A Light in the Attic",
"price": "£51.77",
"availability": "In stock (22 available)",
"reviews": 0
}
trace
provider did not expose step-level events
50-quotes-toscrape-specific
PASS
4.5s · $0.0029
PASS
13.2s · $0.0146
instructionExtract all quotes by Albert Einstein on this page (there should be at least 1). Return JSON: { "quotes": [{ "text": string }] }
{
"type": "object",
"properties": {
"quotes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"text": {
"type": "string"
}
},
"required": [
"text"
]
}
}
},
"required": [
"quotes"
]
}
pre.dev browser agent
extracted
{
"quotes": [
{
"text": "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking."
},
{
"text": "There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle."
},
{
"text": "Try not to become a man of success. Rather become a man of value."
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"quotes": [
{
"text": "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking."
},
{
"text": "There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle."
},
{
"text": "Try not to become a man of success. Rather become a man of value."
}
]
}
trace
provider did not expose step-level events
51-books-category-extract
PASS
17.5s · $0.0234
PASS
15.4s · $0.0183
instructionClick on the "Travel" category in the sidebar, then extract all book titles listed. Return JSON: { "books": [{ "title": string }] }
{
"type": "object",
"properties": {
"books": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"books"
]
}
pre.dev browser agent
extracted
{
"books": [
{
"title": "It's Only the Himalayas"
},
{
"title": "Full Moon over Noah’s ..."
},
{
"title": "See America: A Celebration ..."
},
{
"title": "Vagabonding: An Uncommon Guide ..."
},
{
"title": "Under the Tuscan Sun"
},
{
"title": "A Summer In Europe"
},
{
"title": "The Great Railway Bazaar"
},
{
"title": "A Year in Provence ..."
},
{
"title": "The Road to Little ..."
},
{
"title": "Neither Here nor There: ..."
},
{
"title": "1,000 Places to See ..."
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"books": [
{
"title": "It's Only the Himalayas"
},
{
"title": "Full Moon over Noah’s Ark: An Odyssey to Mount Ararat and Beyond"
},
{
"title": "See America: A Celebration of Our National Parks & Treasured Sites"
},
{
"title": "Vagabonding: An Uncommon Guide to the Art of Long-Term World Travel"
},
{
"title": "Under the Tuscan Sun"
},
{
"title": "A Summer In Europe"
},
{
"title": "The Great Railway Bazaar"
},
{
"title": "A Year in Provence (Provence #1)"
},
{
"title": "The Road to Little Dribbling: Adventures of an American in Britain (Notes From a Small Island #2)"
},
{
"title": "Neither Here nor There: Travels in Europe"
},
{
"title": "1,000 Places to See Before You Die"
}
]
}
trace
provider did not expose step-level events
52-books-mystery-category
PASS
15.5s · $0.0241
PASS
14.7s · $0.0178
instructionNavigate to the Mystery category and extract the first 5 book titles and prices. Return JSON: { "books": [{ "title": string, "price": string }] }
{
"type": "object",
"properties": {
"books": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"price": {
"type": "string"
}
},
"required": [
"title",
"price"
]
}
}
},
"required": [
"books"
]
}
pre.dev browser agent
extracted
{
"books": [
{
"title": "Sharp Objects",
"price": "£47.82"
},
{
"title": "In a Dark, Dark ...",
"price": "£19.63"
},
{
"title": "The Past Never Ends",
"price": "£56.50"
},
{
"title": "A Murder in Time",
"price": "£16.64"
},
{
"title": "The Murder of Roger ...",
"price": "£44.10"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"books": [
{
"title": "Sharp Objects",
"price": "£47.82"
},
{
"title": "In a Dark, Dark Wood",
"price": "£19.63"
},
{
"title": "The Past Never Ends",
"price": "£56.50"
},
{
"title": "A Murder in Time",
"price": "£16.64"
},
{
"title": "The Murder of Roger Ackroyd (Hercule Poirot #4)",
"price": "£44.10"
}
]
}
trace
provider did not expose step-level events
53-books-click-and-detail
PASS
4.7s · $0.0110
PASS
16.8s · $0.0229
instructionClick on the first book shown on the homepage, then extract its full title, price, UPC, and stock availability. Return JSON: { "title": string, "price": string, "upc": string, "stock": string }
{
"type": "object",
"properties": {
"title": {
"type": "string"
},
"price": {
"type": "string"
},
"upc": {
"type": "string"
},
"stock": {
"type": "string"
}
},
"required": [
"title",
"price",
"upc",
"stock"
]
}
pre.dev browser agent
extracted
{
"title": "A Light in the Attic",
"price": "£51.77",
"upc": "978-1-4088-5377-1",
"stock": "In stock"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"title": "A Light in the Attic",
"price": "£51.77",
"upc": "a897fe39b1053632",
"stock": "In stock (22 available)"
}
trace
provider did not expose step-level events
54-books-paginate-count
PASS
3.8s · $0.0044
PASS
12.8s · $0.0165
instructionCount the number of books displayed on this catalogue page. Return JSON: { "count": number }
{
"type": "object",
"properties": {
"count": {
"type": "number"
}
},
"required": [
"count"
]
}
pre.dev browser agent
extracted
{
"count": 20
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"count": 20
}
trace
provider did not expose step-level events
55-quotes-next-page
PASS
17.0s · $0.0207
PASS
16.9s · $0.0173
instructionClick the Next page button and extract the first 3 quote texts from page 2. Return JSON: { "quotes": [{ "text": string }] }
{
"type": "object",
"properties": {
"quotes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"text": {
"type": "string"
}
},
"required": [
"text"
]
}
}
},
"required": [
"quotes"
]
}
pre.dev browser agent
extracted
{
"quotes": [
{
"text": "“It takes a great deal of bravery to stand up to our enemies, but just as much to stand up to our friends.”"
},
{
"text": "“If you can't explain it to a six year old, you don't understand it yourself.”"
},
{
"text": "“I like nonsense, it wakes up the brain cells. Fantasy is a necessary ingredient in living.”"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"quotes": [
{
"text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”"
},
{
"text": "“It takes a great deal of bravery to stand up to our enemies, but just as much to stand up to our friends.”"
},
{
"text": "“If you can't explain it to a six year old, you don't understand it yourself.”"
}
]
}
trace
provider did not expose step-level events
56-quotes-author-page
PASS
3.7s · $0.0087
PASS
35.4s · $0.0211
instructionClick on the first author's name link (not the tag), then extract the author's birth date and place from the author detail page. Return JSON: { "bornDate": string, "bornPlace": string }
{
"type": "object",
"properties": {
"bornDate": {
"type": "string"
},
"bornPlace": {
"type": "string"
}
},
"required": [
"bornDate",
"bornPlace"
]
}
pre.dev browser agent
extracted
{
"bornDate": "May 14, 1879",
"bornPlace": "Ulm, Kingdom of Württemberg, German Empire"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"bornDate": "March 14, 1879",
"bornPlace": "Ulm, Germany"
}
trace
provider did not expose step-level events
57-quotes-tag-filter
PASS
3.9s · $0.0088
PASS
27.1s · $0.0280
instructionClick on the "love" tag, then return the number of quotes shown on the filtered page. Return JSON: { "count": number }
{
"type": "object",
"properties": {
"count": {
"type": "number"
}
},
"required": [
"count"
]
}
pre.dev browser agent
extracted
{
"count": 10
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"count": 14
}
trace
provider did not expose step-level events
58-wikipedia-follow-link
PASS
5.6s · $0.0119
PASS
31.5s · $0.0559
instructionClick on the "ECMAScript" link in the article and extract the first paragraph of the resulting page. Return JSON: { "intro": string }
{
"type": "object",
"properties": {
"intro": {
"type": "string"
}
},
"required": [
"intro"
]
}
pre.dev browser agent
extracted
{
"intro": "JavaScript is a programming language that is one of the core technologies of the World Wide Web, alongside HTML and CSS. As of 2023 JavaScript is the programming language of the web. As of 2022, 98% of websites use JavaScript on the client side for webpage behavior. JavaScript enables interactive web pages and is an essential component of web applications, including desktop applications, mobile apps, web servers, and even games."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"intro": "ECMAScript (/ˈɛkməskrɪpt/; ES) is the standard for the JavaScript language, intended to ensure the interoperability of web pages across different web browsers.[a] It is standardized by Ecma International's TC39 technical committee in the document ECMA-262, with i18n (\"Intl\") APIs standardized in the document ECMA-402."
}
trace
provider did not expose step-level events
59-wikipedia-infobox-data
PASS
4.2s · $0.0260
PASS
61.8s · $0.0796
instructionExtract from the infobox on the right side: the designer name, the date of first appearance, and the current stable release version. Return JSON: { "designer": string, "firstAppeared": string, "stableRelease": string }
{
"type": "object",
"properties": {
"designer": {
"type": "string"
},
"firstAppeared": {
"type": "string"
},
"stableRelease": {
"type": "string"
}
},
"required": [
"designer",
"firstAppeared",
"stableRelease"
]
}
pre.dev browser agent
extracted
{
"designer": "Guido van Rossum",
"firstAppeared": "20 February 1991",
"stableRelease": "3.14.4"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"designer": "Guido van Rossum",
"firstAppeared": "20 February 1991",
"stableRelease": "3.14.4 / 7 April 2026"
}
trace
provider did not expose step-level events
60-wikipedia-references-count
PASS
4.4s · $0.0109
PASS
70.4s · $0.1803
instructionScroll to the References section and count how many references are listed. Return JSON: { "count": number }
{
"type": "object",
"properties": {
"count": {
"type": "number"
}
},
"required": [
"count"
]
}
pre.dev browser agent
extracted
{
"count": 39
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"count": 69
}
trace
provider did not expose step-level events
61-hn-comments-navigate
PASS
4.7s · $0.0101
PASS
19.0s · $0.0364
instructionClick on the comments link of the top story and extract the title of that story and the number of comments. Return JSON: { "title": string, "commentCount": number }
{
"type": "object",
"properties": {
"title": {
"type": "string"
},
"commentCount": {
"type": "number"
}
},
"required": [
"title",
"commentCount"
]
}
pre.dev browser agent
extracted
{
"title": "Poland is now among the 20 largest economies. How it happened",
"commentCount": 327
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"title": "Poland is now among the 20 largest economies. How it happened",
"commentCount": 401
}
trace
provider did not expose step-level events
62-hn-newest-stories
PASS
10.0s · $0.0216
PASS
15.0s · $0.0284
instructionClick the "new" link in the top navigation, then extract the top 3 story titles. Return JSON: { "stories": [{ "title": string }] }
{
"type": "object",
"properties": {
"stories": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"stories"
]
}
pre.dev browser agent
extracted
{
"stories": [
{
"title": "Jan Koum, WhatsApp founder donates record $200M to Shaare Zedek Hospital"
},
{
"title": "Auth Proxy Injection for LLMs"
},
{
"title": "DeepL lays off 25% of its workforce"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stories": [
{
"title": "Plus Codes"
},
{
"title": "iPhone Launch – Studio C (Comedy Sketch) [video]"
},
{
"title": "Show HN: AI Fluency Diagnostic"
}
]
}
trace
provider did not expose step-level events
63-hn-user-profile
PASS
3.0s · $0.0016
PASS
12.9s · $0.0076
instructionExtract the user's karma score and account creation date. Return JSON: { "karma": number, "createdDate": string }
{
"type": "object",
"properties": {
"karma": {
"type": "number"
},
"createdDate": {
"type": "string"
}
},
"required": [
"karma",
"createdDate"
]
}
pre.dev browser agent
extracted
{
"karma": 39312,
"createdDate": "August 18, 2007"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"karma": 39317,
"createdDate": "August 18, 2007"
}
trace
provider did not expose step-level events
64-github-repo-readme-header
PASS
6.8s · $0.0085
PASS
14.7s · $0.0236
instructionExtract the repository description (the tagline at the top) and the programming language used. Return JSON: { "description": string, "language": string }
{
"type": "object",
"properties": {
"description": {
"type": "string"
},
"language": {
"type": "string"
}
},
"required": [
"description",
"language"
]
}
pre.dev browser agent
extracted
{
"description": "TypeScript is a language for application-scale JavaScript. TypeScript adds optional types to JavaScript that support tools for large-scale JavaScript applications for any browser, for any host, on any OS. TypeScript compiles to readable, standards-based JavaScript. Try it out at the playground, and stay up to date via our blog and Twitter account.",
"language": "TypeScript"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"description": "TypeScript is a superset of JavaScript that compiles to clean JavaScript output.",
"language": "TypeScript"
}
trace
provider did not expose step-level events
65-github-navigate-to-issues
PASS
11.6s · $0.0213
PASS
16.9s · $0.0359
instructionClick on the Issues tab and extract the titles of the top 3 open issues. Return JSON: { "issues": [{ "title": string }] }
{
"type": "object",
"properties": {
"issues": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"issues"
]
}
pre.dev browser agent
extracted
{
"issues": [
{
"title": "node/deps/uv/src/uv-common.c fails to compile with current X"
},
{
"title": "meta: backport PR linting requires Signed-off-by"
},
{
"title": "vm: SourceTextModule memory leak - instances retained via async context frames after evaluate()"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"issues": [
{
"title": "node/deps/uv/src/uv-common.c fails to compile with current Xcode, needs libuv cherry-pick"
},
{
"title": "meta: backport PR linting requires Signed-off-by"
},
{
"title": "vm: SourceTextModule memory leak - instances retained via async context frames after evaluate()"
}
]
}
trace
provider did not expose step-level events
66-mdn-javascript-array-methods
PASS
4.2s · $0.0153
PASS
43.2s · $0.0539
instructionExtract the first 5 method names from the instance methods section. Return JSON: { "methods": [string] }
{
"type": "object",
"properties": {
"methods": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"methods"
]
}
pre.dev browser agent
extracted
{
"methods": [
"at()",
"concat()",
"copyWithin()",
"entries()",
"every()"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"methods": [
"at",
"concat",
"copyWithin",
"entries",
"every"
]
}
trace
provider did not expose step-level events
67-mdn-fetch-parameters
PASS
4.3s · $0.0107
PASS
12.6s · $0.0297
instructionExtract the parameters listed for the fetch() function. Return JSON: { "parameters": [string] }
{
"type": "object",
"properties": {
"parameters": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"parameters"
]
}
pre.dev browser agent
extracted
{
"parameters": [
"resource",
"options"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"parameters": [
"resource",
"options"
]
}
trace
provider did not expose step-level events
68-npm-package-version
PASS
3.3s · $0.0022
PASS
12.7s · $0.0108
instructionExtract the current version number and weekly download count. Return JSON: { "version": string, "weeklyDownloads": string }
{
"type": "object",
"properties": {
"version": {
"type": "string"
},
"weeklyDownloads": {
"type": "string"
}
},
"required": [
"version",
"weeklyDownloads"
]
}
pre.dev browser agent
extracted
{
"version": "19.2.6",
"weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"version": "19.2.6",
"weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
69-npm-lodash-dependencies
PASS
3.7s · $0.0022
PASS
10.8s · $0.0108
instructionExtract the package maintainer and the license type. Return JSON: { "maintainer": string, "license": string }
{
"type": "object",
"properties": {
"maintainer": {
"type": "string"
},
"license": {
"type": "string"
}
},
"required": [
"maintainer",
"license"
]
}
pre.dev browser agent
extracted
{
"maintainer": "lodash",
"license": "MIT"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"maintainer": "jdalton",
"license": "MIT"
}
trace
provider did not expose step-level events
71-httpbin-html-table
PASS
3.3s · $0.0018
PASS
10.6s · $0.0089
instructionExtract the author and title from the page. Return JSON: { "author": string, "title": string }
{
"type": "object",
"properties": {
"author": {
"type": "string"
},
"title": {
"type": "string"
}
},
"required": [
"author",
"title"
]
}
pre.dev browser agent
extracted
{
"author": "Herman Melville",
"title": "Moby-Dick"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"author": "Herman Melville",
"title": "Moby-Dick"
}
trace
provider did not expose step-level events
72-jsonplaceholder-nav-post
PASS
9.2s · $0.0176
PASS
12.5s · $0.0117
instructionNavigate to /posts/1 and extract the title and body. Return JSON: { "title": string, "body": string }
{
"type": "object",
"properties": {
"title": {
"type": "string"
},
"body": {
"type": "string"
}
},
"required": [
"title",
"body"
]
}
pre.dev browser agent
extracted
{
"title": "sunt aut facere repellat provident occaecati excepturi optio reprehenderit",
"body": "quia et suscipit\nsuscipit recusandae consequuntur expedita et cum\nreprehenderit molestiae ut ut quas totam\nnostrum rerum est autem sunt rem eveniet architecto"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"title": "sunt aut facere repellat provident occaecati excepturi optio reprehenderit",
"body": "quia et suscipit\nsuscipit recusandae consequuntur expedita et cum\nreprehenderit molestiae ut ut quas totam\nnostrum rerum est autem sunt rem eveniet architecto"
}
trace
provider did not expose step-level events
73-w3schools-css-colors
PASS
4.0s · $0.0114
FAIL
240.0s · $0.0000
instructionExtract the first 5 CSS color names and their hex codes from the reference table. Return JSON: { "colors": [{ "name": string, "hex": string }] }
{
"type": "object",
"properties": {
"colors": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"hex": {
"type": "string"
}
},
"required": [
"name",
"hex"
]
}
}
},
"required": [
"colors"
]
}
pre.dev browser agent
extracted
{
"colors": [
{
"name": "AliceBlue",
"hex": "#F0F8FF"
},
{
"name": "AntiqueWhite",
"hex": "#FAEBD7"
},
{
"name": "Aqua",
"hex": "#00FFFF"
},
{
"name": "Aquamarine",
"hex": "#7FFFD4"
},
{
"name": "Azure",
"hex": "#F0FFFF"
}
]
}
trace
provider did not expose step-level events
browser use cloud
error
TIMEOUT
trace
provider did not expose step-level events
74-scrapethissite-countries
PASS
4.2s · $0.0078
PASS
16.9s · $0.0360
instructionExtract the first 5 country names and their capitals from the list. Return JSON: { "countries": [{ "name": string, "capital": string }] }
{
"type": "object",
"properties": {
"countries": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"capital": {
"type": "string"
}
},
"required": [
"name",
"capital"
]
}
}
},
"required": [
"countries"
]
}
pre.dev browser agent
extracted
{
"countries": [
{
"name": "Andorra",
"capital": "Andorra la Vella"
},
{
"name": "United Arab Emirates",
"capital": "Abu Dhabi"
},
{
"name": "Afghanistan",
"capital": "Kabul"
},
{
"name": "Antigua and Barbuda",
"capital": "Saint John's"
},
{
"name": "Anguilla",
"capital": "The Valley"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"countries": [
{
"name": "Andorra",
"capital": "Andorra la Vella"
},
{
"name": "United Arab Emirates",
"capital": "Abu Dhabi"
},
{
"name": "Afghanistan",
"capital": "Kabul"
},
{
"name": "Antigua and Barbuda",
"capital": "St. John's"
},
{
"name": "Anguilla",
"capital": "The Valley"
}
]
}
trace
provider did not expose step-level events
75-scrapethissite-hockey-table
PASS
4.0s · $0.0033
PASS
16.8s · $0.0137
instructionExtract the first 5 team names and their years from the hockey teams table. Return JSON: { "teams": [{ "name": string, "year": number }] }
{
"type": "object",
"properties": {
"teams": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"year": {
"type": "number"
}
},
"required": [
"name",
"year"
]
}
}
},
"required": [
"teams"
]
}
pre.dev browser agent
extracted
{
"teams": [
{
"name": "Boston Bruins",
"year": 1990
},
{
"name": "Buffalo Sabres",
"year": 1990
},
{
"name": "Calgary Flames",
"year": 1990
},
{
"name": "Chicago Blackhawks",
"year": 1990
},
{
"name": "Detroit Red Wings",
"year": 1990
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"teams": [
{
"name": "Boston Bruins",
"year": 1990
},
{
"name": "Buffalo Sabres",
"year": 1990
},
{
"name": "Calgary Flames",
"year": 1990
},
{
"name": "Chicago Blackhawks",
"year": 1990
},
{
"name": "Detroit Red Wings",
"year": 1990
}
]
}
trace
provider did not expose step-level events
76-the-internet-dropdown
PASS
3.7s · $0.0017
PASS
27.0s · $0.0125
instructionSelect "Option 2" from the dropdown and then return the currently selected option text. Return JSON: { "selected": string }
{
"type": "object",
"properties": {
"selected": {
"type": "string"
}
},
"required": [
"selected"
]
}
pre.dev browser agent
extracted
{
"selected": "Option 2"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"selected": "Option 2"
}
trace
provider did not expose step-level events
77-the-internet-checkboxes
PASS
3.9s · $0.0017
PASS
19.1s · $0.0120
instructionCheck the first checkbox and uncheck the second, then return the final checked state of both. Return JSON: { "first": boolean, "second": boolean }
{
"type": "object",
"properties": {
"first": {
"type": "boolean"
},
"second": {
"type": "boolean"
}
},
"required": [
"first",
"second"
]
}
pre.dev browser agent
extracted
{
"first": true,
"second": false
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"first": true,
"second": false
}
trace
provider did not expose step-level events
78-the-internet-dynamic-content
PASS
4.3s · $0.0020
PASS
16.8s · $0.0111
instructionExtract the text content of the first 3 paragraphs on the page. Return JSON: { "paragraphs": [string] }
{
"type": "object",
"properties": {
"paragraphs": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"paragraphs"
]
}
pre.dev browser agent
extracted
{
"paragraphs": [
"Delectus quisquam atque doloremque molestiae sint quasi iste tempora dolorem sapiente non consequatur itaque repellendus assumenda aliquid a recusandae veritatis sed architecto minima nihil sunt omnis et tenetur fugit officiis numquam rem iure.",
"Repudiandae doloremque illo corporis qui cupiditate dolorum possimus eum laboriosam quisquam nesciunt necessitatibus occaecati ullam maiores quaerat officia quia voluptatibus placeat corrupti explicabo et ea voluptas aliquam sed sed enim ratione ut ipsa quos.",
"Omnis eligendi similique minima optio non aut dolores quo qui est ratione explicabo corporis voluptas inventore dolorum omnis autem et ea perferendis rerum veritatis excepturi repudiandae veniam repellendus odio maiores quia tenetur cupiditate."
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"paragraphs": [
"Nam est aut quidem a dolor atque consequatur quo nostrum vitae ad reprehenderit consequuntur in facilis inventore doloribus odio voluptatem repellendus porro expedita voluptatem quas placeat nemo dolorem quae ab cumque voluptates.",
"Ab exercitationem perferendis voluptatem aut temporibus eius sequi hic sed qui voluptates voluptas ea possimus et sit iste architecto repellendus fuga ut et similique ut placeat odio esse consequatur rerum aut quia.",
"Aliquid aperiam sunt facilis ut et id beatae quaerat consequatur laudantium explicabo natus sequi quia a iste sunt totam et blanditiis voluptatibus est laboriosam nisi odio delectus autem non doloribus hic."
]
}
trace
provider did not expose step-level events
79-the-internet-add-remove
PASS
8.2s · $0.0166
PASS
49.9s · $0.0507
instructionClick the "Add Element" button 3 times, then return the number of "Delete" buttons visible. Return JSON: { "count": number }
{
"type": "object",
"properties": {
"count": {
"type": "number"
}
},
"required": [
"count"
]
}
pre.dev browser agent
extracted
{
"count": 3
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"count": 3
}
trace
provider did not expose step-level events
80-the-internet-iframe
PASS
3.4s · $0.0011
PASS
24.4s · $0.0178
instructionExtract the heading text from the page. Return JSON: { "heading": string }
{
"type": "object",
"properties": {
"heading": {
"type": "string"
}
},
"required": [
"heading"
]
}
pre.dev browser agent
extracted
{
"heading": "An iFrame containing the TinyMCE WYSIWYG Editor"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"heading": "An iFrame containing the TinyMCE WYSIWYG Editor"
}
trace
provider did not expose step-level events
81-books-home-to-category-to-book
PASS
15.3s · $0.0240
PASS
19.6s · $0.0326
instructionClick the Travel category, then click the first book, then extract its UPC code. Return JSON: { "upc": string }
{
"type": "object",
"properties": {
"upc": {
"type": "string"
}
},
"required": [
"upc"
]
}
pre.dev browser agent
extracted
{
"upc": "9781408855652"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"upc": "a22124811bfa8350"
}
trace
provider did not expose step-level events
82-wikipedia-search-result
PASS
5.5s · $0.0104
PASS
82.3s · $0.2435
instructionType "Rust (programming language)" into the Wikipedia search box and press Enter to submit, click the top result, and extract the year it was designed. Return JSON: { "designedYear": number }
{
"type": "object",
"properties": {
"designedYear": {
"type": "number"
}
},
"required": [
"designedYear"
]
}
pre.dev browser agent
extracted
{
"designedYear": 2015
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"designedYear": 2006
}
trace
provider did not expose step-level events
83-quotes-login-and-scrape
PASS
10.0s · $0.0176
PASS
29.1s · $0.0345
instructionLogin with username "user" and password "user", then go to the homepage and extract the first 2 quote texts. Return JSON: { "quotes": [{ "text": string }] }
{
"type": "object",
"properties": {
"quotes": {
"type": "array",
"items": {
"type": "object",
"properties": {
"text": {
"type": "string"
}
},
"required": [
"text"
]
}
}
},
"required": [
"quotes"
]
}
pre.dev browser agent
extracted
{
"quotes": [
{
"text": "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”"
},
{
"text": "“It is our choices, Harry, that show what we truly are, far more than our abilities.”"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"quotes": [
{
"text": "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”"
},
{
"text": "“It is our choices, Harry, that show what we truly are, far more than our abilities.”"
}
]
}
trace
provider did not expose step-level events
84-books-sort-or-filter
PASS
3.0s · $0.0044
PASS
16.6s · $0.0173
instructionExtract the total number of fiction books shown and the lowest-priced book title. Return JSON: { "count": number, "cheapestTitle": string }
{
"type": "object",
"properties": {
"count": {
"type": "number"
},
"cheapestTitle": {
"type": "string"
}
},
"required": [
"count",
"cheapestTitle"
]
}
pre.dev browser agent
extracted
{
"count": 20,
"cheapestTitle": "I Am Pilgrim (Pilgrim ..."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"count": 65,
"cheapestTitle": "I Am Pilgrim (Pilgrim #1)"
}
trace
provider did not expose step-level events
85-scrapethissite-paginate
PASS
8.8s · $0.0174
PASS
12.6s · $0.0084
instructionClick on the "Hockey Teams" link, then extract the first 3 team names. Return JSON: { "teams": [string] }
{
"type": "object",
"properties": {
"teams": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"teams"
]
}
pre.dev browser agent
extracted
{
"teams": [
"Boston Bruins",
"Buffalo Sabres",
"Calgary Flames"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"teams": [
"Boston Bruins",
"Buffalo Sabres",
"Calgary Flames"
]
}
trace
provider did not expose step-level events
86-hn-filter-by-points
PASS
4.8s · $0.0093
PASS
35.6s · $0.0382
instructionExtract the titles of stories that have more than 100 points. Return JSON: { "stories": [{ "title": string, "points": number }] }
{
"type": "object",
"properties": {
"stories": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"points": {
"type": "number"
}
},
"required": [
"title",
"points"
]
}
}
},
"required": [
"stories"
]
}
pre.dev browser agent
extracted
{
"stories": [
{
"title": "Poland is now among the 20 largest economies. How it happened",
"points": 370
},
{
"title": "An Introduction to Meshtastic",
"points": 127
},
{
"title": "Canvas is down as ShinyHunters threatens to leak schools’ data",
"points": 817
},
{
"title": "Cloudflare to cut about 20% workforce",
"points": 1031
},
{
"title": "Maybe you shouldn't install new software for a bit",
"points": 685
},
{
"title": "ClojureScript Gets Async/Await",
"points": 177
},
{
"title": "Dirtyfrag: Universal Linux LPE",
"points": 718
},
{
"title": "Rumors of my death are slightly exaggerated",
"points": 635
},
{
"title": "The map that keeps Burning Man honest",
"points": 697
},
{
"title": "Pinocchio is weirder than you remembered",
"points": 229
},
{
"title": "Agents need control flow, not more prompts",
"points": 526
},
{
"title": "Nintendo announces price increases for Nintendo Switch 2",
"points": 176
},
{
"title": "DeepSeek 4 Flash local inference engine for Metal",
"points": 444
},
{
"title": "Singapore introduces caning for boys who bully others at school",
"points": 263
},
{
"title": "GPT-5.5 Price Increase: What It Costs",
"points": 128
},
{
"title": "Natural Language Autoencoders: Turning Claude's Thoughts into Text",
"points": 331
},
{
"title": "Hardening Firefox with Claude Mythos Preview",
"points": 283
},
{
"title": "Blaise – A modern self-hosting zero-legacy Object Pascal compiler targeting QBE",
"points": 75
},
{
"title": "AlphaEvolve: Gemini-powered coding agent scaling impact across fields",
"points": 313
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stories": [
{
"title": "Poland is now among the 20 largest economies. How it happened",
"points": 499
},
{
"title": "An Introduction to Meshtastic",
"points": 174
},
{
"title": "Cloudflare to cut about 20% workforce",
"points": 1089
},
{
"title": "Canvas is down as ShinyHunters threatens to leak schools’ data",
"points": 842
},
{
"title": "Maybe you shouldn't install new software for a bit",
"points": 710
},
{
"title": "ClojureScript Gets Async/Await",
"points": 210
},
{
"title": "Rumors of my death are slightly exaggerated",
"points": 747
},
{
"title": "Dirtyfrag: Universal Linux LPE",
"points": 728
},
{
"title": "The map that keeps Burning Man honest",
"points": 710
},
{
"title": "Pinocchio is weirder than you remembered",
"points": 244
},
{
"title": "Tesla is recalling its cheaper Cybertruck because the wheels might fall off",
"points": 115
},
{
"title": "Agents need control flow, not more prompts",
"points": 539
},
{
"title": "GPT-5.5 Price Increase: What It Costs",
"points": 143
},
{
"title": "Brazil's Pix payment system faces pressure from Visa and Mastercard",
"points": 328
},
{
"title": "Singapore introduces caning for boys who bully others at school",
"points": 279
},
{
"title": "Hardening Firefox with Claude Mythos Preview",
"points": 296
},
{
"title": "Nintendo announces price increases for Nintendo Switch 2",
"points": 200
},
{
"title": "Natural Language Autoencoders: Turning Claude's Thoughts into Text",
"points": 342
},
{
"title": "DeepSeek 4 Flash local inference engine for Metal",
"points": 455
}
]
}
trace
provider did not expose step-level events
87-books-price-under
PASS
3.3s · $0.0046
PASS
14.8s · $0.0188
instructionExtract the titles and prices of the first 3 books with a price under £20. Return JSON: { "books": [{ "title": string, "price": string }] }
{
"type": "object",
"properties": {
"books": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"price": {
"type": "string"
}
},
"required": [
"title",
"price"
]
}
}
},
"required": [
"books"
]
}
pre.dev browser agent
extracted
{
"books": [
{
"title": "The Coming Woman: A ...",
"price": "£17.93"
},
{
"title": "Starving Hearts (Triangular Trade ...",
"price": "£13.99"
},
{
"title": "Set Me Free",
"price": "£17.46"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"books": [
{
"title": "The Coming Woman: A Novel Based on the Life of the Infamous Feminist, Victoria Woodhull",
"price": "£17.93"
},
{
"title": "Starving Hearts (Triangular Trade Trilogy, #1)",
"price": "£13.99"
},
{
"title": "Set Me Free",
"price": "£17.46"
}
]
}
trace
provider did not expose step-level events
88-wikipedia-list-items
PASS
3.3s · $0.0131
PASS
70.2s · $0.1571
instructionExtract the first 10 programming language names from the list. Return JSON: { "languages": [string] }
{
"type": "object",
"properties": {
"languages": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"languages"
]
}
pre.dev browser agent
extracted
{
"languages": [
"A.NET (A#/A sharp)",
"A-0 System",
"A+ (A plus)",
"ABAP",
"ABC",
"ACC",
"Accent (Rational Synergy)",
"Action!",
"ActionScript",
"Actor"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"languages": [
"A.NET",
"A-0 System",
"A+",
"ABAP",
"ABC",
"ACC",
"Accent",
"Action!",
"ActionScript",
"Actor"
]
}
trace
provider did not expose step-level events
89-wikipedia-table-data
PASS
4.3s · $0.0333
PASS
16.6s · $0.0586
instructionExtract the names and heights (in meters) of the top 3 tallest buildings from the table. Return JSON: { "buildings": [{ "name": string, "heightM": number }] }
{
"type": "object",
"properties": {
"buildings": {
"type": "array",
"items": {
"type": "object",
"properties": {
"name": {
"type": "string"
},
"heightM": {
"type": "number"
}
},
"required": [
"name",
"heightM"
]
}
}
},
"required": [
"buildings"
]
}
pre.dev browser agent
extracted
{
"buildings": [
{
"name": "Burj Khalifa",
"heightM": 828
},
{
"name": "Merdeka 118",
"heightM": 678.9
},
{
"name": "Shanghai Tower",
"heightM": 632
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"buildings": [
{
"name": "Burj Khalifa",
"heightM": 828
},
{
"name": "Merdeka 118",
"heightM": 678.9
},
{
"name": "Shanghai Tower",
"heightM": 632
}
]
}
trace
provider did not expose step-level events
90-wikipedia-category-listing
PASS
4.9s · $0.0101
PASS
54.9s · $0.0813
instructionExtract the first 5 framework names listed on the category page. Return JSON: { "frameworks": [string] }
{
"type": "object",
"properties": {
"frameworks": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"frameworks"
]
}
pre.dev browser agent
extracted
{
"frameworks": [
"AIDA/Web",
"Ametys CMS",
"Anaconda (Python distribution)",
"Apache Cocoon",
"Apache Shale"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"frameworks": [
"AIDA/Web",
"Ametys CMS",
"Anaconda (Python distribution)",
"Apache Cocoon",
"Apache Shale"
]
}
trace
provider did not expose step-level events
91-example-domain-extract
PASS
2.4s · $0.0010
PASS
10.6s · $0.0102
instructionExtract the h1 text and the URL in the "More information..." link. Return JSON: { "heading": string, "linkUrl": string }
{
"type": "object",
"properties": {
"heading": {
"type": "string"
},
"linkUrl": {
"type": "string"
}
},
"required": [
"heading",
"linkUrl"
]
}
pre.dev browser agent
extracted
{
"heading": "Example Domain",
"linkUrl": "https://iana.org/domains/example"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"heading": "Example Domain",
"linkUrl": "https://www.iana.org/domains/example"
}
trace
provider did not expose step-level events
92-quotes-scroll-mode
PASS
4.7s · $0.0073
PASS
21.1s · $0.0215
instructionExtract the first 5 quote texts shown on this infinite-scroll page. Return JSON: { "quotes": [string] }
{
"type": "object",
"properties": {
"quotes": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"quotes"
]
}
pre.dev browser agent
extracted
{
"quotes": [
"“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”",
"“It is our choices, Harry, that show what we truly are, far more than our abilities.”",
"“There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.”",
"“The person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.”",
"“Imperfection is beauty, madness is genius and it's better to be absolutely ridiculous than absolutely boring.”"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"quotes": [
"“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”",
"“It is our choices, Harry, that show what we truly are, far more than our abilities.”",
"“There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.”",
"“The person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.”",
"“Imperfection is beauty, madness is genius and it's better to be absolutely ridiculous than absolutely boring.”"
]
}
trace
provider did not expose step-level events
93-quotes-js-rendered
PASS
4.5s · $0.0100
PASS
18.9s · $0.0162
instructionExtract the first 3 quote authors from the JS-rendered page. Return JSON: { "authors": [string] }
{
"type": "object",
"properties": {
"authors": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"authors"
]
}
pre.dev browser agent
extracted
{
"authors": [
"Albert Einstein",
"J.K. Rowling",
"Albert Einstein"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"authors": [
"Albert Einstein",
"J.K. Rowling",
"Albert Einstein"
]
}
trace
provider did not expose step-level events
94-hn-ask-stories
PASS
3.2s · $0.0040
PASS
18.9s · $0.0260
instructionExtract the titles and point counts of the top 3 Ask HN stories. Return JSON: { "stories": [{ "title": string, "points": number }] }
{
"type": "object",
"properties": {
"stories": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
},
"points": {
"type": "number"
}
},
"required": [
"title",
"points"
]
}
}
},
"required": [
"stories"
]
}
pre.dev browser agent
extracted
{
"stories": [
{
"title": "Ask HN: How are you handling QA being bottlenecked with more AI-generated PRs?",
"points": 3
},
{
"title": "Ask HN: What will happen as AI costs increase?",
"points": 12
},
{
"title": "Ask HN: What is your go-to solution for a personal wiki in 2026?",
"points": 13
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stories": [
{
"title": "Rumors of my death are slightly exaggerated",
"points": 747
},
{
"title": "Ask HN: How do we handle the rise of low quality \"This is LLM\" comments?",
"points": 4
},
{
"title": "Reflections on NetBSD 11",
"points": 3
}
]
}
trace
provider did not expose step-level events
95-hn-show-stories
PASS
2.6s · $0.0065
PASS
12.7s · $0.0174
instructionExtract the top 3 Show HN story titles. Return JSON: { "stories": [{ "title": string }] }
{
"type": "object",
"properties": {
"stories": {
"type": "array",
"items": {
"type": "object",
"properties": {
"title": {
"type": "string"
}
},
"required": [
"title"
]
}
}
},
"required": [
"stories"
]
}
pre.dev browser agent
extracted
{
"stories": [
{
"title": "Show HN: Git for AI Agents"
},
{
"title": "Show HN: Crit – local review tool for agent plans and code diffs"
},
{
"title": "Show HN: TRUST – Coding Rust like it's 1989"
}
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"stories": [
{
"title": "Show HN: Git for AI Agents"
},
{
"title": "Show HN: TRUST – Coding Rust like it's 1989"
},
{
"title": "Show HN: Crit – local review tool for agent plans and code diffs"
}
]
}
trace
provider did not expose step-level events
96-github-trending-like
PASS
5.9s · $0.0077
PASS
14.5s · $0.0376
instructionExtract the names of the first 3 trending repositories shown. Return JSON: { "repos": [string] }
{
"type": "object",
"properties": {
"repos": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"repos"
]
}
pre.dev browser agent
extracted
{
"repos": [
"anthropics / financial-services",
"addyosmani / agent-skills",
"Hmbown / DeepSeek-TUI"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"repos": [
"anthropics/financial-services",
"addyosmani/agent-skills",
"Hmbown/DeepSeek-TUI"
]
}
trace
provider did not expose step-level events
97-mdn-html-elements
PASS
4.6s · $0.0156
PASS
14.6s · $0.0301
instructionExtract the first 5 HTML element names listed in the reference. Return JSON: { "elements": [string] }
{
"type": "object",
"properties": {
"elements": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"elements"
]
}
pre.dev browser agent
extracted
{
"elements": [
"html",
"base",
"head",
"link",
"meta"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"elements": [
"html",
"base",
"head",
"link",
"meta"
]
}
trace
provider did not expose step-level events
98-books-add-to-cart-not
PASS
3.5s · $0.0044
PASS
12.8s · $0.0170
instructionFind the first book whose title starts with "The" and return its title and price. Return JSON: { "title": string, "price": string }
{
"type": "object",
"properties": {
"title": {
"type": "string"
},
"price": {
"type": "string"
}
},
"required": [
"title",
"price"
]
}
pre.dev browser agent
extracted
{
"title": "The Requiem Red",
"price": "£22.65"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"title": "The Requiem Red",
"price": "£22.65"
}
trace
provider did not expose step-level events
99-jsonplaceholder-todos
PASS
3.2s · $0.0101
PASS
12.6s · $0.0260
instructionExtract the titles of the first 3 todos from the JSON response displayed. Return JSON: { "todos": [string] }
{
"type": "object",
"properties": {
"todos": {
"type": "array",
"items": {
"type": "string"
}
}
},
"required": [
"todos"
]
}
pre.dev browser agent
extracted
{
"todos": [
"delectus aut autem",
"quis ut nam facilis et officia qui",
"fugiat veniam minus"
]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"todos": [
"delectus aut autem",
"quis ut nam facilis et officia qui",
"fugiat veniam minus"
]
}
trace
provider did not expose step-level events
trivial-example-h1
PASS
2.5s · $0.0009
PASS
10.7s · $0.0053
instructionExtract the H1 heading text from the page. Return JSON: { "heading": string }
{
"type": "object",
"properties": {
"heading": {
"type": "string"
}
},
"required": [
"heading"
]
}
pre.dev browser agent
extracted
{
"heading": "Example Domain"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"heading": "Example Domain"
}
trace
provider did not expose step-level events
trivial-jsonplaceholder-user
PASS
3.1s · $0.0011
PASS
10.7s · $0.0107
instructionExtract the user's name from the JSON response. Return JSON: { "name": string }
{
"type": "object",
"properties": {
"name": {
"type": "string"
}
},
"required": [
"name"
]
}
pre.dev browser agent
extracted
{
"name": "Leanne Graham"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
"name": "Leanne Graham"
}
trace
provider did not expose step-level events