pre.dev browser-agents-benchmark
run 2026-05-08T14-48-59

head-to-head · 100 browser tasks

leaderboard

ProviderPass rateAvg time/task$/task$ total
pre.dev browser agent100/100 (100%)9.0s$0.0164$1.64
browser use cloud97/100 (97%)30.6s$0.0370$3.70

Browser agents are stochastic — individual runs on cheap-tier models vary by a few tasks per suite. The full per-task JSON and trace for this run is committed so the data can be re-scored independently.

pre.dev browser agentbrowser use cloud
QUALITY best 100.0 COST best $0.0164/task SPEED best 9.0s/task 255075100

per-task analysis

01-hn-top-stories PASS 4.3s · $0.0078 PASS 19.3s · $0.0225
instructionExtract the top 5 story titles and their point counts. Return JSON: { "stories": [{ "title": string, "points": number }] }
{
  "type": "object",
  "properties": {
    "stories": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "points": {
            "type": "number"
          }
        },
        "required": [
          "title",
          "points"
        ]
      }
    }
  },
  "required": [
    "stories"
  ]
}
pre.dev browser agent
extracted
{
  "stories": [
    {
      "title": "Poland is now among the 20 largest economies. How it happened",
      "points": 370
    },
    {
      "title": "An Introduction to Meshtastic",
      "points": 127
    },
    {
      "title": "Canvas is down as ShinyHunters threatens to leak schools’ data",
      "points": 817
    },
    {
      "title": "Cloudflare to cut about 20% workforce",
      "points": 1031
    },
    {
      "title": "GeoJSON",
      "points": 72
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stories": [
    {
      "title": "Poland is now among the 20 largest economies. How it happened",
      "points": 495
    },
    {
      "title": "An Introduction to Meshtastic",
      "points": 173
    },
    {
      "title": "PC Engine CPU",
      "points": 35
    },
    {
      "title": "Podman rootless containers and the Copy Fail exploit",
      "points": 32
    },
    {
      "title": "Serving a Website on a Raspberry Pi Zero Running in RAM",
      "points": 10
    }
  ]
}
trace
provider did not expose step-level events
02-wikipedia-intro PASS 4.5s · $0.0153 PASS 31.4s · $0.0383
instructionExtract the first paragraph of the article (the lede, at least 100 chars). Return JSON: { "intro": string }
{
  "type": "object",
  "properties": {
    "intro": {
      "type": "string"
    }
  },
  "required": [
    "intro"
  ]
}
pre.dev browser agent
extracted
{
  "intro": "Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites.[1] Web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying in which specific data is gathered and copied from the web, typically into a central local database or spreadsheet, for later retrieval or analysis."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "intro": "Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. Web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying in which specific data is gathered and copied from the web, typically into a central local database or spreadsheet, for later retrieval or analysis."
}
trace
provider did not expose step-level events
03-npm-react-version PASS 6.9s · $0.0025 PASS 16.8s · $0.0109
instructionExtract the current version and weekly downloads. Return JSON: { "version": string, "weeklyDownloads": string | number }
{
  "type": "object",
  "properties": {
    "version": {
      "type": "string"
    },
    "weeklyDownloads": {
      "type": "string"
    }
  },
  "required": [
    "version",
    "weeklyDownloads"
  ]
}
pre.dev browser agent
extracted
{
  "version": "19.2.6",
  "weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "version": "19.2.6",
  "weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
04-wikipedia-linus-nationality PASS 4.7s · $0.0214 PASS 32.6s · $0.0626
instructionFrom the infobox, extract Linus Torvalds' nationality. Return JSON: { "nationality": string }
{
  "type": "object",
  "properties": {
    "nationality": {
      "type": "string"
    }
  },
  "required": [
    "nationality"
  ]
}
pre.dev browser agent
extracted
{
  "nationality": "Finnish and American"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "nationality": "Finnish, American"
}
trace
provider did not expose step-level events
05-github-typescript-stats PASS 6.6s · $0.0060 PASS 41.5s · $0.0485
instructionExtract star count, primary language, and latest release. Return JSON: { "stars": string | number, "language": string, "latestRelease": string | null }
{
  "type": "object",
  "properties": {
    "stars": {
      "type": "number"
    },
    "language": {
      "type": "string"
    },
    "latestRelease": {
      "type": "string"
    }
  },
  "required": [
    "stars",
    "language"
  ]
}
pre.dev browser agent
extracted
{
  "stars": 109000,
  "language": "TypeScript",
  "latestRelease": "TypeScript 6.0.3"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stars": 108784,
  "language": "TypeScript",
  "latestRelease": "v6.0.3"
}
trace
provider did not expose step-level events
06-coingecko-btc-price PASS 23.0s · $0.0185 PASS 13.3s · $0.0239
instructionExtract the current Bitcoin price in USD (as a number). Return JSON: { "priceUSD": number }
{
  "type": "object",
  "properties": {
    "priceUSD": {
      "type": "number"
    }
  },
  "required": [
    "priceUSD"
  ]
}
pre.dev browser agent
extracted
{
  "priceUSD": 80259.78
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "priceUSD": 79940.27
}
trace
provider did not expose step-level events
07-mdn-html-elements PASS 5.1s · $0.0158 PASS 15.3s · $0.0281
instructionExtract the names of any 5 HTML elements (like "div", "span"). Return JSON: { "elements": string[] }
{
  "type": "object",
  "properties": {
    "elements": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "elements"
  ]
}
pre.dev browser agent
extracted
{
  "elements": [
    "html",
    "head",
    "link",
    "meta",
    "style",
    "title",
    "body",
    "address",
    "article",
    "aside",
    "footer",
    "header",
    "hgroup",
    "main",
    "nav",
    "section",
    "search",
    "blockquote",
    "dd",
    "div",
    "dl",
    "dt",
    "figcaption",
    "figure",
    "hr",
    "li",
    "menu",
    "ol",
    "p",
    "pre",
    "ul"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "elements": [
    "html",
    "head",
    "body",
    "div",
    "span"
  ]
}
trace
provider did not expose step-level events
08-stackoverflow-git-undo PASS 25.0s · $0.0257 PASS 49.6s · $0.0512
instructionExtract the question title, vote count, and first sentence of the accepted answer. Return JSON: { "title": string, "votes": number, "acceptedAnswer": string }
{
  "type": "object",
  "properties": {
    "title": {
      "type": "string"
    },
    "votes": {
      "type": "number"
    },
    "acceptedAnswer": {
      "type": "string"
    }
  },
  "required": [
    "title",
    "votes",
    "acceptedAnswer"
  ]
}
pre.dev browser agent
extracted
{
  "title": "How do I undo the most recent local commits in Git?",
  "votes": 27211,
  "acceptedAnswer": "There are two ways to \"undo\" your last commit, depending on whether or not you have already made your commit public (pushed to your remote repository):\n\nHow to undo a local commit\n\nLet's say I committed locally, but now I want to remove that commit.\n\ngit log\n    commit 101: bad commit    # Latest commit. This would be called 'HEAD'.\n    commit 100: good commit   # Second to last commit. This is the one we want.\n\nTo restore everything back to the way it was prior to the last commit, we need to reset to the commit before HEAD:\n\ngit reset --soft HEAD^     # Use --soft if you want to keep your changes\ngit reset --hard HEAD^     # Use --hard if you don't care about keeping the changes you made\n\nNow git log will show that our last commit has been removed.\n\nHow to undo a public commit\n\nIf you have already made your commits public, you will want to create a new commit which will \"revert\" the changes you made in your previous commit (current HEAD).\n\ngit revert HEAD\n\nYour changes will now be reverted and ready for you to commit:\n\ngit commit -m 'restoring the file I removed by accident'\ngit log\n    commit 102: restoring the file I removed by accident\n    commit 101: removing a file we don't need\n    commit 100: adding a file that we need\n\nFor more information, check out Git Basics - Undoing Things."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "title": "How do I undo the most recent local commits in Git?",
  "votes": 27211,
  "acceptedAnswer": "git reset is the command responsible for the undo."
}
trace
provider did not expose step-level events
09-lobsters-stories PASS 4.5s · $0.0087 PASS 15.6s · $0.0257
instructionExtract the top 5 story titles and scores. Return JSON: { "stories": [{ "title": string, "score": number }] }
{
  "type": "object",
  "properties": {
    "stories": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "score": {
            "type": "number"
          }
        },
        "required": [
          "title",
          "score"
        ]
      }
    }
  },
  "required": [
    "stories"
  ]
}
pre.dev browser agent
extracted
{
  "stories": [
    {
      "title": "Just Fucking Use Go",
      "score": 27
    },
    {
      "title": "Dirty Frag: Universal Linux LPE",
      "score": 106
    },
    {
      "title": "Stop MITM on the first SSH connection, on any VPS or cloud provider",
      "score": 7
    },
    {
      "title": "jj v0.41.0 is out",
      "score": 64
    },
    {
      "title": "Why Don’t Lowercase Letters Come Right After Uppercase Letters in ASCII?",
      "score": 36
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stories": [
    {
      "title": "Just Fucking Use Go",
      "score": 40
    },
    {
      "title": "Dirty Frag: Universal Linux LPE",
      "score": 107
    },
    {
      "title": "Stop MITM on the first SSH connection, on any VPS or cloud provider",
      "score": 10
    },
    {
      "title": "Why Don’t Lowercase Letters Come Right After Uppercase Letters in ASCII?",
      "score": 38
    },
    {
      "title": "jj v0.41.0 is out",
      "score": 65
    }
  ]
}
trace
provider did not expose step-level events
10-books-toscrape PASS 4.4s · $0.0048 PASS 18.2s · $0.0187
instructionExtract the first 5 book titles and prices. Return JSON: { "books": [{ "title": string, "price": string }] }
{
  "type": "object",
  "properties": {
    "books": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "price": {
            "type": "string"
          }
        },
        "required": [
          "title",
          "price"
        ]
      }
    }
  },
  "required": [
    "books"
  ]
}
pre.dev browser agent
extracted
{
  "books": [
    {
      "title": "A Light in the ...",
      "price": "£51.77"
    },
    {
      "title": "Tipping the Velvet",
      "price": "£53.74"
    },
    {
      "title": "Soumission",
      "price": "£50.10"
    },
    {
      "title": "Sharp Objects",
      "price": "£47.82"
    },
    {
      "title": "Sapiens: A Brief History ...",
      "price": "£54.23"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "books": [
    {
      "title": "A Light in the Attic",
      "price": "£51.77"
    },
    {
      "title": "Tipping the Velvet",
      "price": "£53.74"
    },
    {
      "title": "Soumission",
      "price": "£50.10"
    },
    {
      "title": "Sharp Objects",
      "price": "£47.82"
    },
    {
      "title": "Sapiens: A Brief History of Humankind",
      "price": "£54.23"
    }
  ]
}
trace
provider did not expose step-level events
100-scrapethissite-ajax PASS 8.4s · $0.0173 PASS 52.0s · $0.0380
instructionClick the 2015 link/button and extract the first 3 film titles and their Oscars count. Return JSON: { "films": [{ "title": string, "oscars": number }] }
{
  "type": "object",
  "properties": {
    "films": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "oscars": {
            "type": "number"
          }
        },
        "required": [
          "title",
          "oscars"
        ]
      }
    }
  },
  "required": [
    "films"
  ]
}
pre.dev browser agent
extracted
{
  "films": [
    {
      "title": "Birdman",
      "oscars": 4
    },
    {
      "title": "The Grand Budapest Hotel",
      "oscars": 4
    },
    {
      "title": "Whiplash",
      "oscars": 3
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "films": [
    {
      "title": "Spotlight  ",
      "oscars": 2
    },
    {
      "title": "Mad Max: Fury Road ",
      "oscars": 6
    },
    {
      "title": "The Revenant   ",
      "oscars": 3
    }
  ]
}
trace
provider did not expose step-level events
11-github-react-stats PASS 6.1s · $0.0095 PASS 17.1s · $0.0217
instructionExtract star count and primary language. Return JSON: { "stars": string | number, "language": string }
{
  "type": "object",
  "properties": {
    "stars": {
      "type": "number"
    },
    "language": {
      "type": "string"
    }
  },
  "required": [
    "stars",
    "language"
  ]
}
pre.dev browser agent
extracted
{
  "stars": 245000,
  "language": "JavaScript"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stars": 245000,
  "language": "JavaScript"
}
trace
provider did not expose step-level events
12-wikipedia-python PASS 4.8s · $0.0260 PASS 59.2s · $0.0880
instructionExtract the programming paradigms listed in the infobox (e.g. "multi-paradigm", "object-oriented"). Return JSON: { "paradigms": string }
{
  "type": "object",
  "properties": {
    "paradigms": {
      "type": "string"
    }
  },
  "required": [
    "paradigms"
  ]
}
pre.dev browser agent
extracted
{
  "paradigms": "Multi-paradigm: object-oriented, procedural (imperative), functional, structured, reflective"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "paradigms": "Multi-paradigm: object-oriented, procedural (imperative), functional, structured, reflective"
}
trace
provider did not expose step-level events
13-scrapethissite-countries PASS 5.8s · $0.0078 PASS 14.9s · $0.0295
instructionExtract the first 5 country names and their capitals. Return JSON: { "countries": [{ "name": string, "capital": string }] }
{
  "type": "object",
  "properties": {
    "countries": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "capital": {
            "type": "string"
          }
        },
        "required": [
          "name",
          "capital"
        ]
      }
    }
  },
  "required": [
    "countries"
  ]
}
pre.dev browser agent
extracted
{
  "countries": [
    {
      "name": "Andorra",
      "capital": "Andorra la Vella"
    },
    {
      "name": "United Arab Emirates",
      "capital": "Abu Dhabi"
    },
    {
      "name": "Afghanistan",
      "capital": "Kabul"
    },
    {
      "name": "Antigua and Barbuda",
      "capital": "Saint John's"
    },
    {
      "name": "Anguilla",
      "capital": "The Valley"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "countries": [
    {
      "name": "Andorra",
      "capital": "Andorra la Vella"
    },
    {
      "name": "United Arab Emirates",
      "capital": "Abu Dhabi"
    },
    {
      "name": "Afghanistan",
      "capital": "Kabul"
    },
    {
      "name": "Antigua and Barbuda",
      "capital": "St. John's"
    },
    {
      "name": "Anguilla",
      "capital": "The Valley"
    }
  ]
}
trace
provider did not expose step-level events
14-npm-express-info PASS 5.0s · $0.0046 PASS 14.6s · $0.0180
instructionExtract the package version and description. Return JSON: { "version": string, "description": string }
{
  "type": "object",
  "properties": {
    "version": {
      "type": "string"
    },
    "description": {
      "type": "string"
    }
  },
  "required": [
    "version",
    "description"
  ]
}
pre.dev browser agent
extracted
{
  "version": "5.2.1",
  "description": "Fast, unopinionated, minimalist web framework for Node.js."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "version": "5.2.1",
  "description": "Fast, unopinionated, minimalist web framework for Node.js"
}
trace
provider did not expose step-level events
15-the-internet-tables PASS 14.5s · $0.0100 PASS 16.7s · $0.0111
instructionExtract the data from the first table (Table 1). Return JSON: { "rows": [{ "lastName": string, "firstName": string, "email": string }] } for the first 4 rows.
{
  "type": "object",
  "properties": {
    "rows": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "lastName": {
            "type": "string"
          },
          "firstName": {
            "type": "string"
          },
          "email": {
            "type": "string"
          }
        },
        "required": [
          "lastName",
          "firstName",
          "email"
        ]
      }
    }
  },
  "required": [
    "rows"
  ]
}
pre.dev browser agent
extracted
{
  "rows": [
    {
      "lastName": "Smith",
      "firstName": "John",
      "email": "jsmith@gmail.com"
    },
    {
      "lastName": "Bach",
      "firstName": "Frank",
      "email": "fbach@yahoo.com"
    },
    {
      "lastName": "Doe",
      "firstName": "Jason",
      "email": "jdoe@hotmail.com"
    },
    {
      "lastName": "Conway",
      "firstName": "Tim",
      "email": "tconway@earthlink.net"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "rows": [
    {
      "lastName": "Smith",
      "firstName": "John",
      "email": "jsmith@gmail.com"
    },
    {
      "lastName": "Bach",
      "firstName": "Frank",
      "email": "fbach@yahoo.com"
    },
    {
      "lastName": "Doe",
      "firstName": "Jason",
      "email": "jdoe@hotmail.com"
    },
    {
      "lastName": "Conway",
      "firstName": "Tim",
      "email": "tconway@earthlink.net"
    }
  ]
}
trace
provider did not expose step-level events
16-hn-comments PASS 12.2s · $0.0243 PASS 17.6s · $0.0304
instructionClick on the "comments" link of the first story. After the comments page loads, extract the story title. Return JSON: { "storyTitle": string }
{
  "type": "object",
  "properties": {
    "storyTitle": {
      "type": "string"
    }
  },
  "required": [
    "storyTitle"
  ]
}
pre.dev browser agent
extracted
{
  "storyTitle": "Poland is now among the 20 largest economies. How it happened"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "storyTitle": "Poland is now among the 20 largest economies. How it happened"
}
trace
provider did not expose step-level events
17-github-issues PASS 6.9s · $0.0064 PASS 21.6s · $0.0316
instructionExtract the titles of the first 5 open issues. Return JSON: { "issues": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "issues": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "issues"
  ]
}
pre.dev browser agent
extracted
{
  "issues": [
    {
      "title": "[6.x] Getting'unassingable to type' when returning value from method that needs to infer generic from parameters"
    },
    {
      "title": "String.split() method's separator argument should allow undefined"
    },
    {
      "title": "new super() in static method does not cause error"
    },
    {
      "title": "libReplacement: true lookup folder should be configurable (via typeRoots ?)"
    },
    {
      "title": "symbolToNode stack overflow when using recursive types and functions with type parameters"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "issues": [
    {
      "title": "[6.x] Getting'unassingable to type' when returning value from method that needs to infer generic from parameters"
    },
    {
      "title": "String.split() method's separator argument should allow undefined"
    },
    {
      "title": "`new super()` in static method does not cause error"
    },
    {
      "title": "`libReplacement: true` lookup folder should be configurable (via `typeRoots` ?)"
    },
    {
      "title": "`symbolToNode` stack overflow when using recursive types and functions with type parameters"
    }
  ]
}
trace
provider did not expose step-level events
18-github-releases PASS 7.7s · $0.0217 PASS 39.7s · $0.0527
instructionExtract the title and date of the 3 most recent releases. Return JSON: { "releases": [{ "title": string, "date": string }] }
{
  "type": "object",
  "properties": {
    "releases": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "date": {
            "type": "string"
          }
        },
        "required": [
          "title",
          "date"
        ]
      }
    }
  },
  "required": [
    "releases"
  ]
}
pre.dev browser agent
extracted
{
  "releases": [
    {
      "title": "v2.7.14",
      "date": "2026.04.28"
    },
    {
      "title": "v2.7.13",
      "date": "2026.04.22"
    },
    {
      "title": "v2.7.12",
      "date": "2026.04.09"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "releases": [
    {
      "title": "v2.7.14",
      "date": "2026-04-28T16:49:55Z"
    },
    {
      "title": "v2.7.13",
      "date": "2026-04-22T13:26:47Z"
    },
    {
      "title": "v2.7.12",
      "date": "2026-04-09T20:35:29Z"
    }
  ]
}
trace
provider did not expose step-level events
19-books-page2 PASS 14.2s · $0.0232 PASS 33.8s · $0.0311
instructionClick the "next" button to go to page 2, then extract the first 3 book titles from page 2. Return JSON: { "books": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "books": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "books"
  ]
}
pre.dev browser agent
extracted
{
  "books": [
    {
      "title": "Burning"
    },
    {
      "title": "A Fierce and Subtle ..."
    },
    {
      "title": "Scarlett Epstein Hates It ..."
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "books": [
    {
      "title": "In Her Wake"
    },
    {
      "title": "How Music Works"
    },
    {
      "title": "Foolproof Preserving: A Guide to Small Batch Jams, Jellies, Pickles, Condiments, and More: A Foolproof Guide to Making Small Batch Jams, Jellies, Pickles, Condiments, and More"
    }
  ]
}
trace
provider did not expose step-level events
20-mdn-array-methods PASS 6.4s · $0.0160 PASS 22.3s · $0.0312
instructionExtract 5 Array instance method names from this page (like "map", "filter", "reduce"). Return JSON: { "methods": string[] }
{
  "type": "object",
  "properties": {
    "methods": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "methods"
  ]
}
pre.dev browser agent
extracted
{
  "methods": [
    "at",
    "concat",
    "copyWithin",
    "entries",
    "every",
    "fill",
    "filter",
    "find",
    "findIndex",
    "findLast",
    "findLastIndex",
    "flat",
    "flatMap",
    "forEach",
    "includes",
    "indexOf",
    "join",
    "keys",
    "lastIndexOf",
    "map",
    "pop",
    "push",
    "reduce",
    "reduceRight",
    "reverse",
    "shift",
    "slice",
    "some",
    "sort",
    "splice",
    "toLocaleString",
    "toReversed",
    "toSorted",
    "toSpliced",
    "toString",
    "unshift",
    "values",
    "with"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "methods": [
    "at",
    "concat",
    "copyWithin",
    "entries",
    "every"
  ]
}
trace
provider did not expose step-level events
21-quotes-tag-page PASS 51.3s · $0.1552 PASS 23.0s · $0.0200
instructionClick on the "love" tag link to navigate to the love quotes page. Then extract the first 3 quotes and their authors. Return JSON: { "quotes": [{ "text": string, "author": string }] }
{
  "type": "object",
  "properties": {
    "quotes": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "text": {
            "type": "string"
          },
          "author": {
            "type": "string"
          }
        },
        "required": [
          "text",
          "author"
        ]
      }
    }
  },
  "required": [
    "quotes"
  ]
}
pre.dev browser agent
extracted
{
  "quotes": [
    {
      "text": "“It is better to be hated for what you are than to be loved for what you are not.”",
      "author": "André Gide"
    },
    {
      "text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”",
      "author": "Marilyn Monroe"
    },
    {
      "text": "“You may not be her first, her last, or her only. She loved before she may love again. But if she loves you now, what else matters? She's not perfect—you aren't either, and the two of you may never be perfect together but if she can make you laugh, cause you to think twice, and admit to being human and making mistakes, hold onto her and give her the most you can. She may be thinking about you every second of the day, but she will give you a part of her that she knows you can break—her heart. So don't hurt her, don't change her, don't take her for granted. If she is in your life to give you this chance, let her know that you love her and will not hurt her.”",
      "author": "Bob Marley"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "quotes": [
    {
      "text": "“It is better to be hated for what you are than to be loved for what you are not.”",
      "author": "André Gide"
    },
    {
      "text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”",
      "author": "Marilyn Monroe"
    },
    {
      "text": "“You may not be her first, her last, or her only. She loved before she may love again. But if she loves you now, what else matters? She's not perfect—you aren't either, and the two of you may never be perfect together but if she can make you laugh, cause you to think twice, and admit to being human and making mistakes, hold onto her and give her the most you can. She may not be thinking about you every second of the day, but she will give you a part of her that she knows you can break—her heart. So don't hurt her, don't change her, don't analyze and don't expect more than she can give. Smile when she makes you happy, let her know when she makes you mad, and miss her when she's not there.”",
      "author": "Bob Marley"
    }
  ]
}
trace
provider did not expose step-level events
22-books-science-category PASS 10.7s · $0.0225 PASS 15.3s · $0.0184
instructionClick on the "Science" category link in the sidebar, then extract the first 3 book titles and prices from the Science category page. Return JSON: { "books": [{ "title": string, "price": string }] }
{
  "type": "object",
  "properties": {
    "books": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "price": {
            "type": "string"
          }
        },
        "required": [
          "title",
          "price"
        ]
      }
    }
  },
  "required": [
    "books"
  ]
}
pre.dev browser agent
extracted
{
  "books": [
    {
      "title": "Mesaerion: The Best Science",
      "price": "£37.59"
    },
    {
      "title": "Join",
      "price": "£35.67"
    },
    {
      "title": "William Shakespeare's Star Wars: ...",
      "price": "£43.30"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "books": [
    {
      "title": "The Most Perfect Thing: Inside (and Outside) a Bird's Egg",
      "price": "£42.96"
    },
    {
      "title": "Immunity: How Elie Metchnikoff Changed the Course of Modern Medicine",
      "price": "£57.36"
    },
    {
      "title": "Sorting the Beef from the Bull: The Science of Food Fraud Forensics",
      "price": "£44.74"
    }
  ]
}
trace
provider did not expose step-level events
23-wikipedia-search-openai PASS 20.2s · $0.0246 PASS 64.4s · $0.0729
instructionType "OpenAI" into the search field and press Enter to submit. Extract the first 3 result titles. Return JSON: { "results": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "results": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "results"
  ]
}
pre.dev browser agent
extracted
{
  "results": [
    {
      "title": "OpenAI"
    },
    {
      "title": "OpenAI Global, LLC"
    },
    {
      "title": "OpenAI Foundation"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "results": [
    {
      "title": "OpenAI"
    },
    {
      "title": "Products and applications ofOpenAI"
    },
    {
      "title": "OpenAIo1"
    }
  ]
}
trace
provider did not expose step-level events
24-wikipedia-search-rust PASS 14.3s · $0.0220 PASS 51.9s · $0.0668
instructionType "Rust programming language" into the search field and press Enter to submit. Extract the first 3 result titles. Return JSON: { "results": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "results": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "results"
  ]
}
pre.dev browser agent
extracted
{
  "results": [
    {
      "title": "Rust programming language"
    },
    {
      "title": "Rust"
    },
    {
      "title": "Rust (programming language)"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "results": [
    {
      "title": "Rust(programminglanguage)"
    },
    {
      "title": "Outline of theRustprogramminglanguage"
    },
    {
      "title": "List ofprogramminglanguagesby type"
    }
  ]
}
trace
provider did not expose step-level events
25-npm-search-express PASS 4.8s · $0.0060 PASS 16.0s · $0.0252
instructionExtract the names and descriptions of the first 3 packages. Return JSON: { "packages": [{ "name": string, "description": string }] }
{
  "type": "object",
  "properties": {
    "packages": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "description": {
            "type": "string"
          }
        },
        "required": [
          "name",
          "description"
        ]
      }
    }
  },
  "required": [
    "packages"
  ]
}
pre.dev browser agent
extracted
{
  "packages": [
    {
      "name": "express",
      "description": "Fast, unopinionated, minimalist web framework"
    },
    {
      "name": "@types/express",
      "description": "TypeScript definitions for express"
    },
    {
      "name": "swagger-ui-express",
      "description": "Swagger UI Express"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "packages": [
    {
      "name": "express",
      "description": "Fast, unopinionated, minimalist web framework"
    },
    {
      "name": "@types/express",
      "description": "TypeScript definitions for express"
    },
    {
      "name": "swagger-ui-express",
      "description": "Swagger UI Express"
    }
  ]
}
trace
provider did not expose step-level events
26-quotes-pagination PASS 39.7s · $0.1553 PASS 19.1s · $0.0208
instructionClick the "Next" button to go to page 2. Extract the first 3 quotes and authors from page 2. Return JSON: { "quotes": [{ "text": string, "author": string }] }
{
  "type": "object",
  "properties": {
    "quotes": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "text": {
            "type": "string"
          },
          "author": {
            "type": "string"
          }
        },
        "required": [
          "text",
          "author"
        ]
      }
    }
  },
  "required": [
    "quotes"
  ]
}
pre.dev browser agent
extracted
{
  "quotes": [
    {
      "text": "“The more that you read, the more things you will know. The more that you learn, the more places you'll go.”",
      "author": "Dr. Seuss"
    },
    {
      "text": "“Of course it is happening inside your head, Harry, but why on earth should that mean that it is not real?”",
      "author": "J.K. Rowling"
    },
    {
      "text": "“The truth is, everyone is going to hurt you. You just got to find the ones worth suffering for.”",
      "author": "Bob Marley"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "quotes": [
    {
      "text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”",
      "author": "Marilyn Monroe"
    },
    {
      "text": "“It takes a great deal of bravery to stand up to our enemies, but just as much to stand up to our friends.”",
      "author": "J.K. Rowling"
    },
    {
      "text": "“If you can't explain it to a six year old, you don't understand it yourself.”",
      "author": "Albert Einstein"
    }
  ]
}
trace
provider did not expose step-level events
27-scrapethissite-hockey PASS 5.1s · $0.0033 PASS 15.5s · $0.0144
instructionThis page has a table of hockey teams. Extract the first 5 team names and their wins. Return JSON: { "teams": [{ "name": string, "wins": number }] }
{
  "type": "object",
  "properties": {
    "teams": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "wins": {
            "type": "number"
          }
        },
        "required": [
          "name",
          "wins"
        ]
      }
    }
  },
  "required": [
    "teams"
  ]
}
pre.dev browser agent
extracted
{
  "teams": [
    {
      "name": "Boston Bruins",
      "wins": 44
    },
    {
      "name": "Buffalo Sabres",
      "wins": 31
    },
    {
      "name": "Calgary Flames",
      "wins": 46
    },
    {
      "name": "Chicago Blackhawks",
      "wins": 49
    },
    {
      "name": "Detroit Red Wings",
      "wins": 34
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "teams": [
    {
      "name": "Boston Bruins",
      "wins": 44
    },
    {
      "name": "Buffalo Sabres",
      "wins": 31
    },
    {
      "name": "Calgary Flames",
      "wins": 46
    },
    {
      "name": "Chicago Blackhawks",
      "wins": 49
    },
    {
      "name": "Detroit Red Wings",
      "wins": 34
    }
  ]
}
trace
provider did not expose step-level events
28-weather-gov-sf PASS 6.9s · $0.0045 PASS 33.6s · $0.0369
instructionExtract the current temperature and conditions for San Francisco. Return JSON: { "temperature": string, "conditions": string }
{
  "type": "object",
  "properties": {
    "temperature": {
      "type": "string"
    },
    "conditions": {
      "type": "string"
    }
  },
  "required": [
    "temperature",
    "conditions"
  ]
}
pre.dev browser agent
extracted
{
  "temperature": "52°F",
  "conditions": "NA"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "temperature": "52°F",
  "conditions": "Sunny"
}
trace
provider did not expose step-level events
29-httpbin-pizza PASS 34.1s · $0.0216 PASS 79.8s · $0.0643
instructionFill: customer name "Test User", phone "555-1234", email "test@example.com", comments "Ring the bell". Click Submit. Extract the customer name from the response. Return JSON: { "submittedName": string }
{
  "type": "object",
  "properties": {
    "submittedName": {
      "type": "string"
    }
  },
  "required": [
    "submittedName"
  ]
}
pre.dev browser agent
extracted
{
  "submittedName": "Test User"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "submittedName": "Test User"
}
trace
provider did not expose step-level events
30-demoqa-textbox PASS 60.1s · $0.1643 PASS 27.4s · $0.0192
instructionFill: Full Name "Alice Smith", Email "alice@example.com", Current Address "123 Main St", Permanent Address "456 Oak Ave". Click Submit. Extract the displayed output. Return JSON: { "name": string, "email": string }
{
  "type": "object",
  "properties": {
    "name": {
      "type": "string"
    },
    "email": {
      "type": "string"
    }
  },
  "required": [
    "name",
    "email"
  ]
}
pre.dev browser agent
extracted
{
  "name": "Alice Smith",
  "email": "alice@example.com"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "name": "Alice Smith",
  "email": "alice@example.com"
}
trace
provider did not expose step-level events
31-quotes-login PASS 14.0s · $0.0177 PASS 21.1s · $0.0202
instructionFill username "admin" and password "admin", click Login. Return JSON: { "loggedIn": true } if successful.
{
  "type": "object",
  "properties": {
    "loggedIn": {}
  },
  "required": [
    "loggedIn"
  ]
}
pre.dev browser agent
extracted
{
  "loggedIn": false
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "loggedIn": true
}
trace
provider did not expose step-level events
32-the-internet-login PASS 19.0s · $0.0176 PASS 62.2s · $0.0518
instructionFill username "tomsmith" and password "SuperSecretPassword!", click Login. Return JSON: { "loggedIn": true } if you see the secure area page.
{
  "type": "object",
  "properties": {
    "loggedIn": {}
  },
  "required": [
    "loggedIn"
  ]
}
pre.dev browser agent
extracted
{
  "loggedIn": true
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "loggedIn": true
}
trace
provider did not expose step-level events
33-httpbin-anything PASS 23.0s · $0.0191 PASS 55.9s · $0.0735
instructionFill the form with customer "Bob Jones", size "Large", and topping "Bacon". Click Submit. Extract the customer name. Return JSON: { "customer": string }
{
  "type": "object",
  "properties": {
    "customer": {
      "type": "string"
    }
  },
  "required": [
    "customer"
  ]
}
pre.dev browser agent
extracted
{
  "customer": "Bob Jones"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "customer": "Bob Jones"
}
trace
provider did not expose step-level events
34-the-internet-dropdown PASS 5.0s · $0.0018 PASS 25.1s · $0.0098
instructionSelect "Option 2" from the dropdown menu. Return JSON: { "selected": string } with the selected value.
{
  "type": "object",
  "properties": {
    "selected": {
      "type": "string"
    }
  },
  "required": [
    "selected"
  ]
}
pre.dev browser agent
extracted
{
  "selected": "Option 2"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "selected": "Option 2"
}
trace
provider did not expose step-level events
35-the-internet-checkboxes PASS 7.7s · $0.0021 PASS 19.0s · $0.0117
instructionCheck the first checkbox (if unchecked) and uncheck the second (if checked). Then report the state of both. Return JSON: { "checkbox1": boolean, "checkbox2": boolean }
{
  "type": "object",
  "properties": {
    "checkbox1": {
      "type": "boolean"
    },
    "checkbox2": {
      "type": "boolean"
    }
  },
  "required": [
    "checkbox1",
    "checkbox2"
  ]
}
pre.dev browser agent
extracted
{
  "checkbox1": true,
  "checkbox2": false
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "checkbox1": true,
  "checkbox2": false
}
trace
provider did not expose step-level events
36-wikipedia-search-submit-extract PASS 14.2s · $0.0233 PASS 66.3s · $0.0874
instructionType "machine learning" into the search field and press Enter to submit. Extract the first 3 result titles. Return JSON: { "results": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "results": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "results"
  ]
}
pre.dev browser agent
extracted
{
  "results": [
    {
      "title": "Machine learning"
    },
    {
      "title": "Artificial intelligence"
    },
    {
      "title": "Data mining"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "results": [
    {
      "title": "Machine learning"
    },
    {
      "title": "Outline of machine learning"
    },
    {
      "title": "Attention (machine learning)"
    }
  ]
}
trace
provider did not expose step-level events
37-quotes-login-then-scrape PASS 11.7s · $0.0180 PASS 80.2s · $0.0668
instructionLog in with username "admin" and password "admin". After login, extract the first 3 quotes and their authors from the homepage. Return JSON: { "quotes": [{ "text": string, "author": string }] }
{
  "type": "object",
  "properties": {
    "quotes": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "text": {
            "type": "string"
          },
          "author": {
            "type": "string"
          }
        },
        "required": [
          "text",
          "author"
        ]
      }
    }
  },
  "required": [
    "quotes"
  ]
}
pre.dev browser agent
extracted
{
  "quotes": [
    {
      "text": "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”",
      "author": "Albert Einstein"
    },
    {
      "text": "“It is our choices, Harry, that show what we truly are, far more than our abilities.”",
      "author": "J.K. Rowling"
    },
    {
      "text": "“There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.”",
      "author": "Albert Einstein"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "quotes": [
    {
      "text": "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.",
      "author": "Albert Einstein"
    },
    {
      "text": "It is our choices, Harry, that show what we truly are, far more than our abilities.",
      "author": "J.K. Rowling"
    },
    {
      "text": "There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.",
      "author": "Albert Einstein"
    }
  ]
}
trace
provider did not expose step-level events
38-github-nextjs-stats PASS 7.8s · $0.0131 PASS 65.9s · $0.0834
instructionExtract the star count, primary language, and description. Return JSON: { "stars": string | number, "language": string, "description": string }
{
  "type": "object",
  "properties": {
    "stars": {
      "type": "number"
    },
    "language": {
      "type": "string"
    },
    "description": {
      "type": "string"
    }
  },
  "required": [
    "stars",
    "language",
    "description"
  ]
}
pre.dev browser agent
extracted
{
  "stars": 139000,
  "language": "JavaScript",
  "description": "The React Framework"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stars": 139335,
  "language": "JavaScript",
  "description": "The React Framework"
}
trace
provider did not expose step-level events
39-npm-zod-info PASS 5.0s · $0.0033 PASS 12.5s · $0.0131
instructionExtract the version number and description. Return JSON: { "version": string, "description": string }
{
  "type": "object",
  "properties": {
    "version": {
      "type": "string"
    },
    "description": {
      "type": "string"
    }
  },
  "required": [
    "version",
    "description"
  ]
}
pre.dev browser agent
extracted
{
  "version": "4.4.3",
  "description": "TypeScript-first schema validation with static type inference"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "version": "4.4.3",
  "description": "TypeScript-first schema validation with static type inference"
}
trace
provider did not expose step-level events
40-wikipedia-js-intro PASS 5.6s · $0.0240 FAIL 29.0s · $0.0693
instructionExtract the first paragraph of the article body. Return JSON: { "intro": string }
{
  "type": "object",
  "properties": {
    "intro": {
      "type": "string"
    }
  },
  "required": [
    "intro"
  ]
}
pre.dev browser agent
extracted
{
  "intro": "JavaScript\n\nJavaScript (JS)[a] is a programming language and core technology of the Web, alongside HTML and CSS. Created by Brendan Eich in 1995,[6] it is maintained by Ecma International's TC39 technical committee,[10] with related Web APIs maintained by W3C and WHATWG.[11] As of 2025, JavaScript is the most widely used programming language on GitHub.[b][12]"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "intro": ""
}
trace
provider did not expose step-level events
41-example-com PASS 4.6s · $0.0011 PASS 10.9s · $0.0101
instructionExtract the main heading text and the first paragraph text. Return JSON: { "heading": string, "paragraph": string }
{
  "type": "object",
  "properties": {
    "heading": {
      "type": "string"
    },
    "paragraph": {
      "type": "string"
    }
  },
  "required": [
    "heading",
    "paragraph"
  ]
}
pre.dev browser agent
extracted
{
  "heading": "Example Domain",
  "paragraph": "This domain is for use in documentation examples without needing permission. Avoid use in operations."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "heading": "Example Domain",
  "paragraph": "This domain is for use in documentation examples without needing permission. Avoid use in operations."
}
trace
provider did not expose step-level events
42-jsonplaceholder-users PASS 5.8s · $0.0086 PASS 14.8s · $0.0221
instructionThis page shows raw JSON. Extract the names and emails of the first 3 users. Return JSON: { "users": [{ "name": string, "email": string }] }
{
  "type": "object",
  "properties": {
    "users": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "email": {
            "type": "string"
          }
        },
        "required": [
          "name",
          "email"
        ]
      }
    }
  },
  "required": [
    "users"
  ]
}
pre.dev browser agent
extracted
{
  "users": [
    {
      "name": "Leanne Graham",
      "email": "Sincere@april.biz"
    },
    {
      "name": "Ervin Howell",
      "email": "Shanna@melissa.tv"
    },
    {
      "name": "Clementine Bauch",
      "email": "Nathan@yesenia.net"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "users": [
    {
      "name": "Leanne Graham",
      "email": "Sincere@april.biz"
    },
    {
      "name": "Ervin Howell",
      "email": "Shanna@melissa.tv"
    },
    {
      "name": "Clementine Bauch",
      "email": "Nathan@yesenia.net"
    }
  ]
}
trace
provider did not expose step-level events
44-turnstile-login PASS 35.2s · $0.0295 FAIL 120.0s · $0.0000
instructionFill username "testuser" and password "testpass", wait for Turnstile to validate, then click Sign in. Return JSON: { "submitted": true } if successful.
{
  "type": "object",
  "properties": {
    "loggedIn": {}
  },
  "required": [
    "loggedIn"
  ]
}
pre.dev browser agent
extracted
{
  "loggedIn": "true"
}
trace
provider did not expose step-level events
browser use cloud
error
TIMEOUT
trace
provider did not expose step-level events
45-wikipedia-rust-intro PASS 5.6s · $0.0274 PASS 97.2s · $0.1957
instructionExtract the first paragraph of the article. Return JSON: { "intro": string }
{
  "type": "object",
  "properties": {
    "intro": {
      "type": "string"
    }
  },
  "required": [
    "intro"
  ]
}
pre.dev browser agent
extracted
{
  "intro": "Rust is a general-purpose programming language which emphasizes performance, type safety, concurrency, and memory safety.\n\nRust supports multiple programming paradigms. It was influenced by ideas from functional programming, including immutability, higher-order functions, algebraic data types, and pattern matching. It also supports object-oriented programming via structs, enums, traits, and methods. Rust enforces memory safety (i.e., that all references point to valid memory) without a conventional garbage collector; instead, memory safety errors and data races are prevented by the \"borrow checker\", which tracks the object lifetime of references at compile time.\n\nSoftware developer Graydon Hoare created Rust in 2006 while working at Mozilla, which officially sponsored the project in 2009. The first stable release, Rust 1.0, was published in May 2015. Following a layoff of Mozilla employees in August 2020, four other companies joined Mozilla in sponsoring Rust through the creation of the Rust Foundation in February 2021.\n\nRust has been adopted by many software projects, especially web services and system software. It has been studied academically and has a growing community of developers."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "intro": "Rust is a general-purpose programming language which emphasizes performance, type safety, concurrency, and memory safety."
}
trace
provider did not expose step-level events
46-mdn-css-display PASS 6.5s · $0.0151 PASS 19.0s · $0.0462
instructionExtract the formal syntax values for the CSS display property (e.g. "block", "inline", "flex", "grid", "none"). Return JSON: { "values": string[] }
{
  "type": "object",
  "properties": {
    "values": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "values"
  ]
}
pre.dev browser agent
extracted
{
  "values": [
    "block",
    "inline",
    "flow",
    "flow-root",
    "table",
    "flex",
    "grid",
    "ruby",
    "list-item",
    "table-row-group",
    "table-header-group",
    "table-footer-group",
    "table-row",
    "table-cell",
    "table-column-group",
    "table-column",
    "table-caption",
    "ruby-base",
    "ruby-text",
    "ruby-base-container",
    "ruby-text-container",
    "contents",
    "none",
    "inline-block",
    "inline-table",
    "inline-flex",
    "inline-grid"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "values": [
    "block",
    "inline",
    "run-in",
    "flow",
    "flow-root",
    "table",
    "flex",
    "grid",
    "ruby",
    "list-item",
    "table-row-group",
    "table-header-group",
    "table-footer-group",
    "table-row",
    "table-cell",
    "table-column-group",
    "table-column",
    "table-caption",
    "ruby-base",
    "ruby-text",
    "ruby-base-container",
    "ruby-text-container",
    "contents",
    "none",
    "inline-block",
    "inline-table",
    "inline-flex",
    "inline-grid",
    "math",
    "grid-lanes",
    "inline-grid-lanes"
  ]
}
trace
provider did not expose step-level events
47-quotes-all-tags PASS 4.4s · $0.0027 PASS 13.0s · $0.0145
instructionExtract the top 10 tags shown in the sidebar tag cloud. Return JSON: { "tags": string[] }
{
  "type": "object",
  "properties": {
    "tags": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "tags"
  ]
}
pre.dev browser agent
extracted
{
  "tags": [
    "love",
    "inspirational",
    "life",
    "humor",
    "books",
    "reading",
    "friendship",
    "friends",
    "truth",
    "simile"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "tags": [
    "love",
    "inspirational",
    "life",
    "humor",
    "books",
    "reading",
    "friendship",
    "friends",
    "truth",
    "simile"
  ]
}
trace
provider did not expose step-level events
48-github-deno-releases PASS 7.5s · $0.0213 PASS 12.7s · $0.0519
instructionExtract the latest release version tag (e.g. "v2.3.1") and its title. Return JSON: { "version": string, "title": string }
{
  "type": "object",
  "properties": {
    "version": {
      "type": "string"
    },
    "title": {
      "type": "string"
    }
  },
  "required": [
    "version",
    "title"
  ]
}
pre.dev browser agent
extracted
{
  "version": "v2.7.14",
  "title": "feat(ext/node): add fs.Utf8Stream\nfeat(upgrade): delta updates via bsdiff patches (#33274)\nfix(bundle): treat CSS                             "
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "version": "v2.7.14",
  "title": "2.7.14 / 2026.04.28"
}
trace
provider did not expose step-level events
49-books-toscrape-details PASS 4.4s · $0.0017 PASS 10.6s · $0.0077
instructionExtract the book title, price, availability, and number of reviews. Return JSON: { "title": string, "price": string, "availability": string, "reviews": number }
{
  "type": "object",
  "properties": {
    "title": {
      "type": "string"
    },
    "price": {
      "type": "string"
    },
    "availability": {
      "type": "string"
    },
    "reviews": {
      "type": "number"
    }
  },
  "required": [
    "title",
    "price",
    "availability",
    "reviews"
  ]
}
pre.dev browser agent
extracted
{
  "title": "A Light in the Attic",
  "price": "£51.77",
  "availability": "In stock (22 available)",
  "reviews": 0
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "title": "A Light in the Attic",
  "price": "£51.77",
  "availability": "In stock (22 available)",
  "reviews": 0
}
trace
provider did not expose step-level events
50-quotes-toscrape-specific PASS 4.5s · $0.0029 PASS 13.2s · $0.0146
instructionExtract all quotes by Albert Einstein on this page (there should be at least 1). Return JSON: { "quotes": [{ "text": string }] }
{
  "type": "object",
  "properties": {
    "quotes": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "text": {
            "type": "string"
          }
        },
        "required": [
          "text"
        ]
      }
    }
  },
  "required": [
    "quotes"
  ]
}
pre.dev browser agent
extracted
{
  "quotes": [
    {
      "text": "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking."
    },
    {
      "text": "There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle."
    },
    {
      "text": "Try not to become a man of success. Rather become a man of value."
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "quotes": [
    {
      "text": "The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking."
    },
    {
      "text": "There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle."
    },
    {
      "text": "Try not to become a man of success. Rather become a man of value."
    }
  ]
}
trace
provider did not expose step-level events
51-books-category-extract PASS 17.5s · $0.0234 PASS 15.4s · $0.0183
instructionClick on the "Travel" category in the sidebar, then extract all book titles listed. Return JSON: { "books": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "books": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "books"
  ]
}
pre.dev browser agent
extracted
{
  "books": [
    {
      "title": "It's Only the Himalayas"
    },
    {
      "title": "Full Moon over Noah’s ..."
    },
    {
      "title": "See America: A Celebration ..."
    },
    {
      "title": "Vagabonding: An Uncommon Guide ..."
    },
    {
      "title": "Under the Tuscan Sun"
    },
    {
      "title": "A Summer In Europe"
    },
    {
      "title": "The Great Railway Bazaar"
    },
    {
      "title": "A Year in Provence ..."
    },
    {
      "title": "The Road to Little ..."
    },
    {
      "title": "Neither Here nor There: ..."
    },
    {
      "title": "1,000 Places to See ..."
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "books": [
    {
      "title": "It's Only the Himalayas"
    },
    {
      "title": "Full Moon over Noah’s Ark: An Odyssey to Mount Ararat and Beyond"
    },
    {
      "title": "See America: A Celebration of Our National Parks & Treasured Sites"
    },
    {
      "title": "Vagabonding: An Uncommon Guide to the Art of Long-Term World Travel"
    },
    {
      "title": "Under the Tuscan Sun"
    },
    {
      "title": "A Summer In Europe"
    },
    {
      "title": "The Great Railway Bazaar"
    },
    {
      "title": "A Year in Provence (Provence #1)"
    },
    {
      "title": "The Road to Little Dribbling: Adventures of an American in Britain (Notes From a Small Island #2)"
    },
    {
      "title": "Neither Here nor There: Travels in Europe"
    },
    {
      "title": "1,000 Places to See Before You Die"
    }
  ]
}
trace
provider did not expose step-level events
52-books-mystery-category PASS 15.5s · $0.0241 PASS 14.7s · $0.0178
instructionNavigate to the Mystery category and extract the first 5 book titles and prices. Return JSON: { "books": [{ "title": string, "price": string }] }
{
  "type": "object",
  "properties": {
    "books": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "price": {
            "type": "string"
          }
        },
        "required": [
          "title",
          "price"
        ]
      }
    }
  },
  "required": [
    "books"
  ]
}
pre.dev browser agent
extracted
{
  "books": [
    {
      "title": "Sharp Objects",
      "price": "£47.82"
    },
    {
      "title": "In a Dark, Dark ...",
      "price": "£19.63"
    },
    {
      "title": "The Past Never Ends",
      "price": "£56.50"
    },
    {
      "title": "A Murder in Time",
      "price": "£16.64"
    },
    {
      "title": "The Murder of Roger ...",
      "price": "£44.10"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "books": [
    {
      "title": "Sharp Objects",
      "price": "£47.82"
    },
    {
      "title": "In a Dark, Dark Wood",
      "price": "£19.63"
    },
    {
      "title": "The Past Never Ends",
      "price": "£56.50"
    },
    {
      "title": "A Murder in Time",
      "price": "£16.64"
    },
    {
      "title": "The Murder of Roger Ackroyd (Hercule Poirot #4)",
      "price": "£44.10"
    }
  ]
}
trace
provider did not expose step-level events
53-books-click-and-detail PASS 4.7s · $0.0110 PASS 16.8s · $0.0229
instructionClick on the first book shown on the homepage, then extract its full title, price, UPC, and stock availability. Return JSON: { "title": string, "price": string, "upc": string, "stock": string }
{
  "type": "object",
  "properties": {
    "title": {
      "type": "string"
    },
    "price": {
      "type": "string"
    },
    "upc": {
      "type": "string"
    },
    "stock": {
      "type": "string"
    }
  },
  "required": [
    "title",
    "price",
    "upc",
    "stock"
  ]
}
pre.dev browser agent
extracted
{
  "title": "A Light in the Attic",
  "price": "£51.77",
  "upc": "978-1-4088-5377-1",
  "stock": "In stock"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "title": "A Light in the Attic",
  "price": "£51.77",
  "upc": "a897fe39b1053632",
  "stock": "In stock (22 available)"
}
trace
provider did not expose step-level events
54-books-paginate-count PASS 3.8s · $0.0044 PASS 12.8s · $0.0165
instructionCount the number of books displayed on this catalogue page. Return JSON: { "count": number }
{
  "type": "object",
  "properties": {
    "count": {
      "type": "number"
    }
  },
  "required": [
    "count"
  ]
}
pre.dev browser agent
extracted
{
  "count": 20
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "count": 20
}
trace
provider did not expose step-level events
55-quotes-next-page PASS 17.0s · $0.0207 PASS 16.9s · $0.0173
instructionClick the Next page button and extract the first 3 quote texts from page 2. Return JSON: { "quotes": [{ "text": string }] }
{
  "type": "object",
  "properties": {
    "quotes": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "text": {
            "type": "string"
          }
        },
        "required": [
          "text"
        ]
      }
    }
  },
  "required": [
    "quotes"
  ]
}
pre.dev browser agent
extracted
{
  "quotes": [
    {
      "text": "“It takes a great deal of bravery to stand up to our enemies, but just as much to stand up to our friends.”"
    },
    {
      "text": "“If you can't explain it to a six year old, you don't understand it yourself.”"
    },
    {
      "text": "“I like nonsense, it wakes up the brain cells. Fantasy is a necessary ingredient in living.”"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "quotes": [
    {
      "text": "“This life is what you make it. No matter what, you're going to mess up sometimes, it's a universal truth. But the good part is you get to decide how you're going to mess it up. Girls will be your friends - they'll act like it anyway. But just remember, some come, some go. The ones that stay with you through everything - they're your true best friends. Don't let go of them. Also remember, sisters make the best friends in the world. As for lovers, well, they'll come and go too. And baby, I hate to say it, most of them - actually pretty much all of them are going to break your heart, but you can't give up because if you give up, you'll never find your soulmate. You'll never find that half who makes you whole and that goes for everything. Just because you fail once, doesn't mean you're gonna fail at everything. Keep trying, hold on, and always, always, always believe in yourself, because if you don't, then who will, sweetie? So keep your head high, keep your chin up, and most importantly, keep smiling, because life's a beautiful thing and there's so much to smile about.”"
    },
    {
      "text": "“It takes a great deal of bravery to stand up to our enemies, but just as much to stand up to our friends.”"
    },
    {
      "text": "“If you can't explain it to a six year old, you don't understand it yourself.”"
    }
  ]
}
trace
provider did not expose step-level events
56-quotes-author-page PASS 3.7s · $0.0087 PASS 35.4s · $0.0211
instructionClick on the first author's name link (not the tag), then extract the author's birth date and place from the author detail page. Return JSON: { "bornDate": string, "bornPlace": string }
{
  "type": "object",
  "properties": {
    "bornDate": {
      "type": "string"
    },
    "bornPlace": {
      "type": "string"
    }
  },
  "required": [
    "bornDate",
    "bornPlace"
  ]
}
pre.dev browser agent
extracted
{
  "bornDate": "May 14, 1879",
  "bornPlace": "Ulm, Kingdom of Württemberg, German Empire"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "bornDate": "March 14, 1879",
  "bornPlace": "Ulm, Germany"
}
trace
provider did not expose step-level events
57-quotes-tag-filter PASS 3.9s · $0.0088 PASS 27.1s · $0.0280
instructionClick on the "love" tag, then return the number of quotes shown on the filtered page. Return JSON: { "count": number }
{
  "type": "object",
  "properties": {
    "count": {
      "type": "number"
    }
  },
  "required": [
    "count"
  ]
}
pre.dev browser agent
extracted
{
  "count": 10
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "count": 14
}
trace
provider did not expose step-level events
58-wikipedia-follow-link PASS 5.6s · $0.0119 PASS 31.5s · $0.0559
instructionClick on the "ECMAScript" link in the article and extract the first paragraph of the resulting page. Return JSON: { "intro": string }
{
  "type": "object",
  "properties": {
    "intro": {
      "type": "string"
    }
  },
  "required": [
    "intro"
  ]
}
pre.dev browser agent
extracted
{
  "intro": "JavaScript is a programming language that is one of the core technologies of the World Wide Web, alongside HTML and CSS. As of 2023 JavaScript is the programming language of the web. As of 2022, 98% of websites use JavaScript on the client side for webpage behavior. JavaScript enables interactive web pages and is an essential component of web applications, including desktop applications, mobile apps, web servers, and even games."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "intro": "ECMAScript (/ˈɛkməskrɪpt/; ES) is the standard for the JavaScript language, intended to ensure the interoperability of web pages across different web browsers.[a] It is standardized by Ecma International's TC39 technical committee in the document ECMA-262, with i18n (\"Intl\") APIs standardized in the document ECMA-402."
}
trace
provider did not expose step-level events
59-wikipedia-infobox-data PASS 4.2s · $0.0260 PASS 61.8s · $0.0796
instructionExtract from the infobox on the right side: the designer name, the date of first appearance, and the current stable release version. Return JSON: { "designer": string, "firstAppeared": string, "stableRelease": string }
{
  "type": "object",
  "properties": {
    "designer": {
      "type": "string"
    },
    "firstAppeared": {
      "type": "string"
    },
    "stableRelease": {
      "type": "string"
    }
  },
  "required": [
    "designer",
    "firstAppeared",
    "stableRelease"
  ]
}
pre.dev browser agent
extracted
{
  "designer": "Guido van Rossum",
  "firstAppeared": "20 February 1991",
  "stableRelease": "3.14.4"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "designer": "Guido van Rossum",
  "firstAppeared": "20 February 1991",
  "stableRelease": "3.14.4 / 7 April 2026"
}
trace
provider did not expose step-level events
60-wikipedia-references-count PASS 4.4s · $0.0109 PASS 70.4s · $0.1803
instructionScroll to the References section and count how many references are listed. Return JSON: { "count": number }
{
  "type": "object",
  "properties": {
    "count": {
      "type": "number"
    }
  },
  "required": [
    "count"
  ]
}
pre.dev browser agent
extracted
{
  "count": 39
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "count": 69
}
trace
provider did not expose step-level events
61-hn-comments-navigate PASS 4.7s · $0.0101 PASS 19.0s · $0.0364
instructionClick on the comments link of the top story and extract the title of that story and the number of comments. Return JSON: { "title": string, "commentCount": number }
{
  "type": "object",
  "properties": {
    "title": {
      "type": "string"
    },
    "commentCount": {
      "type": "number"
    }
  },
  "required": [
    "title",
    "commentCount"
  ]
}
pre.dev browser agent
extracted
{
  "title": "Poland is now among the 20 largest economies. How it happened",
  "commentCount": 327
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "title": "Poland is now among the 20 largest economies. How it happened",
  "commentCount": 401
}
trace
provider did not expose step-level events
62-hn-newest-stories PASS 10.0s · $0.0216 PASS 15.0s · $0.0284
instructionClick the "new" link in the top navigation, then extract the top 3 story titles. Return JSON: { "stories": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "stories": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "stories"
  ]
}
pre.dev browser agent
extracted
{
  "stories": [
    {
      "title": "Jan Koum, WhatsApp founder donates record $200M to Shaare Zedek Hospital"
    },
    {
      "title": "Auth Proxy Injection for LLMs"
    },
    {
      "title": "DeepL lays off 25% of its workforce"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stories": [
    {
      "title": "Plus Codes"
    },
    {
      "title": "iPhone Launch – Studio C (Comedy Sketch) [video]"
    },
    {
      "title": "Show HN: AI Fluency Diagnostic"
    }
  ]
}
trace
provider did not expose step-level events
63-hn-user-profile PASS 3.0s · $0.0016 PASS 12.9s · $0.0076
instructionExtract the user's karma score and account creation date. Return JSON: { "karma": number, "createdDate": string }
{
  "type": "object",
  "properties": {
    "karma": {
      "type": "number"
    },
    "createdDate": {
      "type": "string"
    }
  },
  "required": [
    "karma",
    "createdDate"
  ]
}
pre.dev browser agent
extracted
{
  "karma": 39312,
  "createdDate": "August 18, 2007"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "karma": 39317,
  "createdDate": "August 18, 2007"
}
trace
provider did not expose step-level events
64-github-repo-readme-header PASS 6.8s · $0.0085 PASS 14.7s · $0.0236
instructionExtract the repository description (the tagline at the top) and the programming language used. Return JSON: { "description": string, "language": string }
{
  "type": "object",
  "properties": {
    "description": {
      "type": "string"
    },
    "language": {
      "type": "string"
    }
  },
  "required": [
    "description",
    "language"
  ]
}
pre.dev browser agent
extracted
{
  "description": "TypeScript is a language for application-scale JavaScript. TypeScript adds optional types to JavaScript that support tools for large-scale JavaScript applications for any browser, for any host, on any OS. TypeScript compiles to readable, standards-based JavaScript. Try it out at the playground, and stay up to date via our blog and Twitter account.",
  "language": "TypeScript"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "description": "TypeScript is a superset of JavaScript that compiles to clean JavaScript output.",
  "language": "TypeScript"
}
trace
provider did not expose step-level events
65-github-navigate-to-issues PASS 11.6s · $0.0213 PASS 16.9s · $0.0359
instructionClick on the Issues tab and extract the titles of the top 3 open issues. Return JSON: { "issues": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "issues": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "issues"
  ]
}
pre.dev browser agent
extracted
{
  "issues": [
    {
      "title": "node/deps/uv/src/uv-common.c fails to compile with current X"
    },
    {
      "title": "meta: backport PR linting requires Signed-off-by"
    },
    {
      "title": "vm: SourceTextModule memory leak - instances retained via async context frames after evaluate()"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "issues": [
    {
      "title": "node/deps/uv/src/uv-common.c fails to compile with current Xcode, needs libuv cherry-pick"
    },
    {
      "title": "meta: backport PR linting requires Signed-off-by"
    },
    {
      "title": "vm: SourceTextModule memory leak - instances retained via async context frames after evaluate()"
    }
  ]
}
trace
provider did not expose step-level events
66-mdn-javascript-array-methods PASS 4.2s · $0.0153 PASS 43.2s · $0.0539
instructionExtract the first 5 method names from the instance methods section. Return JSON: { "methods": [string] }
{
  "type": "object",
  "properties": {
    "methods": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "methods"
  ]
}
pre.dev browser agent
extracted
{
  "methods": [
    "at()",
    "concat()",
    "copyWithin()",
    "entries()",
    "every()"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "methods": [
    "at",
    "concat",
    "copyWithin",
    "entries",
    "every"
  ]
}
trace
provider did not expose step-level events
67-mdn-fetch-parameters PASS 4.3s · $0.0107 PASS 12.6s · $0.0297
instructionExtract the parameters listed for the fetch() function. Return JSON: { "parameters": [string] }
{
  "type": "object",
  "properties": {
    "parameters": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "parameters"
  ]
}
pre.dev browser agent
extracted
{
  "parameters": [
    "resource",
    "options"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "parameters": [
    "resource",
    "options"
  ]
}
trace
provider did not expose step-level events
68-npm-package-version PASS 3.3s · $0.0022 PASS 12.7s · $0.0108
instructionExtract the current version number and weekly download count. Return JSON: { "version": string, "weeklyDownloads": string }
{
  "type": "object",
  "properties": {
    "version": {
      "type": "string"
    },
    "weeklyDownloads": {
      "type": "string"
    }
  },
  "required": [
    "version",
    "weeklyDownloads"
  ]
}
pre.dev browser agent
extracted
{
  "version": "19.2.6",
  "weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "version": "19.2.6",
  "weeklyDownloads": "121,618,158"
}
trace
provider did not expose step-level events
69-npm-lodash-dependencies PASS 3.7s · $0.0022 PASS 10.8s · $0.0108
instructionExtract the package maintainer and the license type. Return JSON: { "maintainer": string, "license": string }
{
  "type": "object",
  "properties": {
    "maintainer": {
      "type": "string"
    },
    "license": {
      "type": "string"
    }
  },
  "required": [
    "maintainer",
    "license"
  ]
}
pre.dev browser agent
extracted
{
  "maintainer": "lodash",
  "license": "MIT"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "maintainer": "jdalton",
  "license": "MIT"
}
trace
provider did not expose step-level events
71-httpbin-html-table PASS 3.3s · $0.0018 PASS 10.6s · $0.0089
instructionExtract the author and title from the page. Return JSON: { "author": string, "title": string }
{
  "type": "object",
  "properties": {
    "author": {
      "type": "string"
    },
    "title": {
      "type": "string"
    }
  },
  "required": [
    "author",
    "title"
  ]
}
pre.dev browser agent
extracted
{
  "author": "Herman Melville",
  "title": "Moby-Dick"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "author": "Herman Melville",
  "title": "Moby-Dick"
}
trace
provider did not expose step-level events
72-jsonplaceholder-nav-post PASS 9.2s · $0.0176 PASS 12.5s · $0.0117
instructionNavigate to /posts/1 and extract the title and body. Return JSON: { "title": string, "body": string }
{
  "type": "object",
  "properties": {
    "title": {
      "type": "string"
    },
    "body": {
      "type": "string"
    }
  },
  "required": [
    "title",
    "body"
  ]
}
pre.dev browser agent
extracted
{
  "title": "sunt aut facere repellat provident occaecati excepturi optio reprehenderit",
  "body": "quia et suscipit\nsuscipit recusandae consequuntur expedita et cum\nreprehenderit molestiae ut ut quas totam\nnostrum rerum est autem sunt rem eveniet architecto"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "title": "sunt aut facere repellat provident occaecati excepturi optio reprehenderit",
  "body": "quia et suscipit\nsuscipit recusandae consequuntur expedita et cum\nreprehenderit molestiae ut ut quas totam\nnostrum rerum est autem sunt rem eveniet architecto"
}
trace
provider did not expose step-level events
73-w3schools-css-colors PASS 4.0s · $0.0114 FAIL 240.0s · $0.0000
instructionExtract the first 5 CSS color names and their hex codes from the reference table. Return JSON: { "colors": [{ "name": string, "hex": string }] }
{
  "type": "object",
  "properties": {
    "colors": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "hex": {
            "type": "string"
          }
        },
        "required": [
          "name",
          "hex"
        ]
      }
    }
  },
  "required": [
    "colors"
  ]
}
pre.dev browser agent
extracted
{
  "colors": [
    {
      "name": "AliceBlue",
      "hex": "#F0F8FF"
    },
    {
      "name": "AntiqueWhite",
      "hex": "#FAEBD7"
    },
    {
      "name": "Aqua",
      "hex": "#00FFFF"
    },
    {
      "name": "Aquamarine",
      "hex": "#7FFFD4"
    },
    {
      "name": "Azure",
      "hex": "#F0FFFF"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
error
TIMEOUT
trace
provider did not expose step-level events
74-scrapethissite-countries PASS 4.2s · $0.0078 PASS 16.9s · $0.0360
instructionExtract the first 5 country names and their capitals from the list. Return JSON: { "countries": [{ "name": string, "capital": string }] }
{
  "type": "object",
  "properties": {
    "countries": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "capital": {
            "type": "string"
          }
        },
        "required": [
          "name",
          "capital"
        ]
      }
    }
  },
  "required": [
    "countries"
  ]
}
pre.dev browser agent
extracted
{
  "countries": [
    {
      "name": "Andorra",
      "capital": "Andorra la Vella"
    },
    {
      "name": "United Arab Emirates",
      "capital": "Abu Dhabi"
    },
    {
      "name": "Afghanistan",
      "capital": "Kabul"
    },
    {
      "name": "Antigua and Barbuda",
      "capital": "Saint John's"
    },
    {
      "name": "Anguilla",
      "capital": "The Valley"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "countries": [
    {
      "name": "Andorra",
      "capital": "Andorra la Vella"
    },
    {
      "name": "United Arab Emirates",
      "capital": "Abu Dhabi"
    },
    {
      "name": "Afghanistan",
      "capital": "Kabul"
    },
    {
      "name": "Antigua and Barbuda",
      "capital": "St. John's"
    },
    {
      "name": "Anguilla",
      "capital": "The Valley"
    }
  ]
}
trace
provider did not expose step-level events
75-scrapethissite-hockey-table PASS 4.0s · $0.0033 PASS 16.8s · $0.0137
instructionExtract the first 5 team names and their years from the hockey teams table. Return JSON: { "teams": [{ "name": string, "year": number }] }
{
  "type": "object",
  "properties": {
    "teams": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "year": {
            "type": "number"
          }
        },
        "required": [
          "name",
          "year"
        ]
      }
    }
  },
  "required": [
    "teams"
  ]
}
pre.dev browser agent
extracted
{
  "teams": [
    {
      "name": "Boston Bruins",
      "year": 1990
    },
    {
      "name": "Buffalo Sabres",
      "year": 1990
    },
    {
      "name": "Calgary Flames",
      "year": 1990
    },
    {
      "name": "Chicago Blackhawks",
      "year": 1990
    },
    {
      "name": "Detroit Red Wings",
      "year": 1990
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "teams": [
    {
      "name": "Boston Bruins",
      "year": 1990
    },
    {
      "name": "Buffalo Sabres",
      "year": 1990
    },
    {
      "name": "Calgary Flames",
      "year": 1990
    },
    {
      "name": "Chicago Blackhawks",
      "year": 1990
    },
    {
      "name": "Detroit Red Wings",
      "year": 1990
    }
  ]
}
trace
provider did not expose step-level events
76-the-internet-dropdown PASS 3.7s · $0.0017 PASS 27.0s · $0.0125
instructionSelect "Option 2" from the dropdown and then return the currently selected option text. Return JSON: { "selected": string }
{
  "type": "object",
  "properties": {
    "selected": {
      "type": "string"
    }
  },
  "required": [
    "selected"
  ]
}
pre.dev browser agent
extracted
{
  "selected": "Option 2"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "selected": "Option 2"
}
trace
provider did not expose step-level events
77-the-internet-checkboxes PASS 3.9s · $0.0017 PASS 19.1s · $0.0120
instructionCheck the first checkbox and uncheck the second, then return the final checked state of both. Return JSON: { "first": boolean, "second": boolean }
{
  "type": "object",
  "properties": {
    "first": {
      "type": "boolean"
    },
    "second": {
      "type": "boolean"
    }
  },
  "required": [
    "first",
    "second"
  ]
}
pre.dev browser agent
extracted
{
  "first": true,
  "second": false
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "first": true,
  "second": false
}
trace
provider did not expose step-level events
78-the-internet-dynamic-content PASS 4.3s · $0.0020 PASS 16.8s · $0.0111
instructionExtract the text content of the first 3 paragraphs on the page. Return JSON: { "paragraphs": [string] }
{
  "type": "object",
  "properties": {
    "paragraphs": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "paragraphs"
  ]
}
pre.dev browser agent
extracted
{
  "paragraphs": [
    "Delectus quisquam atque doloremque molestiae sint quasi iste tempora dolorem sapiente non consequatur itaque repellendus assumenda aliquid a recusandae veritatis sed architecto minima nihil sunt omnis et tenetur fugit officiis numquam rem iure.",
    "Repudiandae doloremque illo corporis qui cupiditate dolorum possimus eum laboriosam quisquam nesciunt necessitatibus occaecati ullam maiores quaerat officia quia voluptatibus placeat corrupti explicabo et ea voluptas aliquam sed sed enim ratione ut ipsa quos.",
    "Omnis eligendi similique minima optio non aut dolores quo qui est ratione explicabo corporis voluptas inventore dolorum omnis autem et ea perferendis rerum veritatis excepturi repudiandae veniam repellendus odio maiores quia tenetur cupiditate."
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "paragraphs": [
    "Nam est aut quidem a dolor atque consequatur quo nostrum vitae ad reprehenderit consequuntur in facilis inventore doloribus odio voluptatem repellendus porro expedita voluptatem quas placeat nemo dolorem quae ab cumque voluptates.",
    "Ab exercitationem perferendis voluptatem aut temporibus eius sequi hic sed qui voluptates voluptas ea possimus et sit iste architecto repellendus fuga ut et similique ut placeat odio esse consequatur rerum aut quia.",
    "Aliquid aperiam sunt facilis ut et id beatae quaerat consequatur laudantium explicabo natus sequi quia a iste sunt totam et blanditiis voluptatibus est laboriosam nisi odio delectus autem non doloribus hic."
  ]
}
trace
provider did not expose step-level events
79-the-internet-add-remove PASS 8.2s · $0.0166 PASS 49.9s · $0.0507
instructionClick the "Add Element" button 3 times, then return the number of "Delete" buttons visible. Return JSON: { "count": number }
{
  "type": "object",
  "properties": {
    "count": {
      "type": "number"
    }
  },
  "required": [
    "count"
  ]
}
pre.dev browser agent
extracted
{
  "count": 3
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "count": 3
}
trace
provider did not expose step-level events
80-the-internet-iframe PASS 3.4s · $0.0011 PASS 24.4s · $0.0178
instructionExtract the heading text from the page. Return JSON: { "heading": string }
{
  "type": "object",
  "properties": {
    "heading": {
      "type": "string"
    }
  },
  "required": [
    "heading"
  ]
}
pre.dev browser agent
extracted
{
  "heading": "An iFrame containing the TinyMCE WYSIWYG Editor"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "heading": "An iFrame containing the TinyMCE WYSIWYG Editor"
}
trace
provider did not expose step-level events
81-books-home-to-category-to-book PASS 15.3s · $0.0240 PASS 19.6s · $0.0326
instructionClick the Travel category, then click the first book, then extract its UPC code. Return JSON: { "upc": string }
{
  "type": "object",
  "properties": {
    "upc": {
      "type": "string"
    }
  },
  "required": [
    "upc"
  ]
}
pre.dev browser agent
extracted
{
  "upc": "9781408855652"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "upc": "a22124811bfa8350"
}
trace
provider did not expose step-level events
82-wikipedia-search-result PASS 5.5s · $0.0104 PASS 82.3s · $0.2435
instructionType "Rust (programming language)" into the Wikipedia search box and press Enter to submit, click the top result, and extract the year it was designed. Return JSON: { "designedYear": number }
{
  "type": "object",
  "properties": {
    "designedYear": {
      "type": "number"
    }
  },
  "required": [
    "designedYear"
  ]
}
pre.dev browser agent
extracted
{
  "designedYear": 2015
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "designedYear": 2006
}
trace
provider did not expose step-level events
83-quotes-login-and-scrape PASS 10.0s · $0.0176 PASS 29.1s · $0.0345
instructionLogin with username "user" and password "user", then go to the homepage and extract the first 2 quote texts. Return JSON: { "quotes": [{ "text": string }] }
{
  "type": "object",
  "properties": {
    "quotes": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "text": {
            "type": "string"
          }
        },
        "required": [
          "text"
        ]
      }
    }
  },
  "required": [
    "quotes"
  ]
}
pre.dev browser agent
extracted
{
  "quotes": [
    {
      "text": "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”"
    },
    {
      "text": "“It is our choices, Harry, that show what we truly are, far more than our abilities.”"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "quotes": [
    {
      "text": "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”"
    },
    {
      "text": "“It is our choices, Harry, that show what we truly are, far more than our abilities.”"
    }
  ]
}
trace
provider did not expose step-level events
84-books-sort-or-filter PASS 3.0s · $0.0044 PASS 16.6s · $0.0173
instructionExtract the total number of fiction books shown and the lowest-priced book title. Return JSON: { "count": number, "cheapestTitle": string }
{
  "type": "object",
  "properties": {
    "count": {
      "type": "number"
    },
    "cheapestTitle": {
      "type": "string"
    }
  },
  "required": [
    "count",
    "cheapestTitle"
  ]
}
pre.dev browser agent
extracted
{
  "count": 20,
  "cheapestTitle": "I Am Pilgrim (Pilgrim ..."
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "count": 65,
  "cheapestTitle": "I Am Pilgrim (Pilgrim #1)"
}
trace
provider did not expose step-level events
85-scrapethissite-paginate PASS 8.8s · $0.0174 PASS 12.6s · $0.0084
instructionClick on the "Hockey Teams" link, then extract the first 3 team names. Return JSON: { "teams": [string] }
{
  "type": "object",
  "properties": {
    "teams": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "teams"
  ]
}
pre.dev browser agent
extracted
{
  "teams": [
    "Boston Bruins",
    "Buffalo Sabres",
    "Calgary Flames"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "teams": [
    "Boston Bruins",
    "Buffalo Sabres",
    "Calgary Flames"
  ]
}
trace
provider did not expose step-level events
86-hn-filter-by-points PASS 4.8s · $0.0093 PASS 35.6s · $0.0382
instructionExtract the titles of stories that have more than 100 points. Return JSON: { "stories": [{ "title": string, "points": number }] }
{
  "type": "object",
  "properties": {
    "stories": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "points": {
            "type": "number"
          }
        },
        "required": [
          "title",
          "points"
        ]
      }
    }
  },
  "required": [
    "stories"
  ]
}
pre.dev browser agent
extracted
{
  "stories": [
    {
      "title": "Poland is now among the 20 largest economies. How it happened",
      "points": 370
    },
    {
      "title": "An Introduction to Meshtastic",
      "points": 127
    },
    {
      "title": "Canvas is down as ShinyHunters threatens to leak schools’ data",
      "points": 817
    },
    {
      "title": "Cloudflare to cut about 20% workforce",
      "points": 1031
    },
    {
      "title": "Maybe you shouldn't install new software for a bit",
      "points": 685
    },
    {
      "title": "ClojureScript Gets Async/Await",
      "points": 177
    },
    {
      "title": "Dirtyfrag: Universal Linux LPE",
      "points": 718
    },
    {
      "title": "Rumors of my death are slightly exaggerated",
      "points": 635
    },
    {
      "title": "The map that keeps Burning Man honest",
      "points": 697
    },
    {
      "title": "Pinocchio is weirder than you remembered",
      "points": 229
    },
    {
      "title": "Agents need control flow, not more prompts",
      "points": 526
    },
    {
      "title": "Nintendo announces price increases for Nintendo Switch 2",
      "points": 176
    },
    {
      "title": "DeepSeek 4 Flash local inference engine for Metal",
      "points": 444
    },
    {
      "title": "Singapore introduces caning for boys who bully others at school",
      "points": 263
    },
    {
      "title": "GPT-5.5 Price Increase: What It Costs",
      "points": 128
    },
    {
      "title": "Natural Language Autoencoders: Turning Claude's Thoughts into Text",
      "points": 331
    },
    {
      "title": "Hardening Firefox with Claude Mythos Preview",
      "points": 283
    },
    {
      "title": "Blaise – A modern self-hosting zero-legacy Object Pascal compiler targeting QBE",
      "points": 75
    },
    {
      "title": "AlphaEvolve: Gemini-powered coding agent scaling impact across fields",
      "points": 313
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stories": [
    {
      "title": "Poland is now among the 20 largest economies. How it happened",
      "points": 499
    },
    {
      "title": "An Introduction to Meshtastic",
      "points": 174
    },
    {
      "title": "Cloudflare to cut about 20% workforce",
      "points": 1089
    },
    {
      "title": "Canvas is down as ShinyHunters threatens to leak schools’ data",
      "points": 842
    },
    {
      "title": "Maybe you shouldn't install new software for a bit",
      "points": 710
    },
    {
      "title": "ClojureScript Gets Async/Await",
      "points": 210
    },
    {
      "title": "Rumors of my death are slightly exaggerated",
      "points": 747
    },
    {
      "title": "Dirtyfrag: Universal Linux LPE",
      "points": 728
    },
    {
      "title": "The map that keeps Burning Man honest",
      "points": 710
    },
    {
      "title": "Pinocchio is weirder than you remembered",
      "points": 244
    },
    {
      "title": "Tesla is recalling its cheaper Cybertruck because the wheels might fall off",
      "points": 115
    },
    {
      "title": "Agents need control flow, not more prompts",
      "points": 539
    },
    {
      "title": "GPT-5.5 Price Increase: What It Costs",
      "points": 143
    },
    {
      "title": "Brazil's Pix payment system faces pressure from Visa and Mastercard",
      "points": 328
    },
    {
      "title": "Singapore introduces caning for boys who bully others at school",
      "points": 279
    },
    {
      "title": "Hardening Firefox with Claude Mythos Preview",
      "points": 296
    },
    {
      "title": "Nintendo announces price increases for Nintendo Switch 2",
      "points": 200
    },
    {
      "title": "Natural Language Autoencoders: Turning Claude's Thoughts into Text",
      "points": 342
    },
    {
      "title": "DeepSeek 4 Flash local inference engine for Metal",
      "points": 455
    }
  ]
}
trace
provider did not expose step-level events
87-books-price-under PASS 3.3s · $0.0046 PASS 14.8s · $0.0188
instructionExtract the titles and prices of the first 3 books with a price under £20. Return JSON: { "books": [{ "title": string, "price": string }] }
{
  "type": "object",
  "properties": {
    "books": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "price": {
            "type": "string"
          }
        },
        "required": [
          "title",
          "price"
        ]
      }
    }
  },
  "required": [
    "books"
  ]
}
pre.dev browser agent
extracted
{
  "books": [
    {
      "title": "The Coming Woman: A ...",
      "price": "£17.93"
    },
    {
      "title": "Starving Hearts (Triangular Trade ...",
      "price": "£13.99"
    },
    {
      "title": "Set Me Free",
      "price": "£17.46"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "books": [
    {
      "title": "The Coming Woman: A Novel Based on the Life of the Infamous Feminist, Victoria Woodhull",
      "price": "£17.93"
    },
    {
      "title": "Starving Hearts (Triangular Trade Trilogy, #1)",
      "price": "£13.99"
    },
    {
      "title": "Set Me Free",
      "price": "£17.46"
    }
  ]
}
trace
provider did not expose step-level events
88-wikipedia-list-items PASS 3.3s · $0.0131 PASS 70.2s · $0.1571
instructionExtract the first 10 programming language names from the list. Return JSON: { "languages": [string] }
{
  "type": "object",
  "properties": {
    "languages": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "languages"
  ]
}
pre.dev browser agent
extracted
{
  "languages": [
    "A.NET (A#/A sharp)",
    "A-0 System",
    "A+ (A plus)",
    "ABAP",
    "ABC",
    "ACC",
    "Accent (Rational Synergy)",
    "Action!",
    "ActionScript",
    "Actor"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "languages": [
    "A.NET",
    "A-0 System",
    "A+",
    "ABAP",
    "ABC",
    "ACC",
    "Accent",
    "Action!",
    "ActionScript",
    "Actor"
  ]
}
trace
provider did not expose step-level events
89-wikipedia-table-data PASS 4.3s · $0.0333 PASS 16.6s · $0.0586
instructionExtract the names and heights (in meters) of the top 3 tallest buildings from the table. Return JSON: { "buildings": [{ "name": string, "heightM": number }] }
{
  "type": "object",
  "properties": {
    "buildings": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": {
            "type": "string"
          },
          "heightM": {
            "type": "number"
          }
        },
        "required": [
          "name",
          "heightM"
        ]
      }
    }
  },
  "required": [
    "buildings"
  ]
}
pre.dev browser agent
extracted
{
  "buildings": [
    {
      "name": "Burj Khalifa",
      "heightM": 828
    },
    {
      "name": "Merdeka 118",
      "heightM": 678.9
    },
    {
      "name": "Shanghai Tower",
      "heightM": 632
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "buildings": [
    {
      "name": "Burj Khalifa",
      "heightM": 828
    },
    {
      "name": "Merdeka 118",
      "heightM": 678.9
    },
    {
      "name": "Shanghai Tower",
      "heightM": 632
    }
  ]
}
trace
provider did not expose step-level events
90-wikipedia-category-listing PASS 4.9s · $0.0101 PASS 54.9s · $0.0813
instructionExtract the first 5 framework names listed on the category page. Return JSON: { "frameworks": [string] }
{
  "type": "object",
  "properties": {
    "frameworks": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "frameworks"
  ]
}
pre.dev browser agent
extracted
{
  "frameworks": [
    "AIDA/Web",
    "Ametys CMS",
    "Anaconda (Python distribution)",
    "Apache Cocoon",
    "Apache Shale"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "frameworks": [
    "AIDA/Web",
    "Ametys CMS",
    "Anaconda (Python distribution)",
    "Apache Cocoon",
    "Apache Shale"
  ]
}
trace
provider did not expose step-level events
91-example-domain-extract PASS 2.4s · $0.0010 PASS 10.6s · $0.0102
instructionExtract the h1 text and the URL in the "More information..." link. Return JSON: { "heading": string, "linkUrl": string }
{
  "type": "object",
  "properties": {
    "heading": {
      "type": "string"
    },
    "linkUrl": {
      "type": "string"
    }
  },
  "required": [
    "heading",
    "linkUrl"
  ]
}
pre.dev browser agent
extracted
{
  "heading": "Example Domain",
  "linkUrl": "https://iana.org/domains/example"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "heading": "Example Domain",
  "linkUrl": "https://www.iana.org/domains/example"
}
trace
provider did not expose step-level events
92-quotes-scroll-mode PASS 4.7s · $0.0073 PASS 21.1s · $0.0215
instructionExtract the first 5 quote texts shown on this infinite-scroll page. Return JSON: { "quotes": [string] }
{
  "type": "object",
  "properties": {
    "quotes": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "quotes"
  ]
}
pre.dev browser agent
extracted
{
  "quotes": [
    "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”",
    "“It is our choices, Harry, that show what we truly are, far more than our abilities.”",
    "“There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.”",
    "“The person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.”",
    "“Imperfection is beauty, madness is genius and it's better to be absolutely ridiculous than absolutely boring.”"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "quotes": [
    "“The world as we have created it is a process of our thinking. It cannot be changed without changing our thinking.”",
    "“It is our choices, Harry, that show what we truly are, far more than our abilities.”",
    "“There are only two ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle.”",
    "“The person, be it gentleman or lady, who has not pleasure in a good novel, must be intolerably stupid.”",
    "“Imperfection is beauty, madness is genius and it's better to be absolutely ridiculous than absolutely boring.”"
  ]
}
trace
provider did not expose step-level events
93-quotes-js-rendered PASS 4.5s · $0.0100 PASS 18.9s · $0.0162
instructionExtract the first 3 quote authors from the JS-rendered page. Return JSON: { "authors": [string] }
{
  "type": "object",
  "properties": {
    "authors": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "authors"
  ]
}
pre.dev browser agent
extracted
{
  "authors": [
    "Albert Einstein",
    "J.K. Rowling",
    "Albert Einstein"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "authors": [
    "Albert Einstein",
    "J.K. Rowling",
    "Albert Einstein"
  ]
}
trace
provider did not expose step-level events
94-hn-ask-stories PASS 3.2s · $0.0040 PASS 18.9s · $0.0260
instructionExtract the titles and point counts of the top 3 Ask HN stories. Return JSON: { "stories": [{ "title": string, "points": number }] }
{
  "type": "object",
  "properties": {
    "stories": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          },
          "points": {
            "type": "number"
          }
        },
        "required": [
          "title",
          "points"
        ]
      }
    }
  },
  "required": [
    "stories"
  ]
}
pre.dev browser agent
extracted
{
  "stories": [
    {
      "title": "Ask HN: How are you handling QA being bottlenecked with more AI-generated PRs?",
      "points": 3
    },
    {
      "title": "Ask HN: What will happen as AI costs increase?",
      "points": 12
    },
    {
      "title": "Ask HN: What is your go-to solution for a personal wiki in 2026?",
      "points": 13
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stories": [
    {
      "title": "Rumors of my death are slightly exaggerated",
      "points": 747
    },
    {
      "title": "Ask HN: How do we handle the rise of low quality \"This is LLM\" comments?",
      "points": 4
    },
    {
      "title": "Reflections on NetBSD 11",
      "points": 3
    }
  ]
}
trace
provider did not expose step-level events
95-hn-show-stories PASS 2.6s · $0.0065 PASS 12.7s · $0.0174
instructionExtract the top 3 Show HN story titles. Return JSON: { "stories": [{ "title": string }] }
{
  "type": "object",
  "properties": {
    "stories": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "title": {
            "type": "string"
          }
        },
        "required": [
          "title"
        ]
      }
    }
  },
  "required": [
    "stories"
  ]
}
pre.dev browser agent
extracted
{
  "stories": [
    {
      "title": "Show HN: Git for AI Agents"
    },
    {
      "title": "Show HN: Crit – local review tool for agent plans and code diffs"
    },
    {
      "title": "Show HN: TRUST – Coding Rust like it's 1989"
    }
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "stories": [
    {
      "title": "Show HN: Git for AI Agents"
    },
    {
      "title": "Show HN: TRUST – Coding Rust like it's 1989"
    },
    {
      "title": "Show HN: Crit – local review tool for agent plans and code diffs"
    }
  ]
}
trace
provider did not expose step-level events
96-github-trending-like PASS 5.9s · $0.0077 PASS 14.5s · $0.0376
instructionExtract the names of the first 3 trending repositories shown. Return JSON: { "repos": [string] }
{
  "type": "object",
  "properties": {
    "repos": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "repos"
  ]
}
pre.dev browser agent
extracted
{
  "repos": [
    "anthropics / financial-services",
    "addyosmani / agent-skills",
    "Hmbown / DeepSeek-TUI"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "repos": [
    "anthropics/financial-services",
    "addyosmani/agent-skills",
    "Hmbown/DeepSeek-TUI"
  ]
}
trace
provider did not expose step-level events
97-mdn-html-elements PASS 4.6s · $0.0156 PASS 14.6s · $0.0301
instructionExtract the first 5 HTML element names listed in the reference. Return JSON: { "elements": [string] }
{
  "type": "object",
  "properties": {
    "elements": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "elements"
  ]
}
pre.dev browser agent
extracted
{
  "elements": [
    "html",
    "base",
    "head",
    "link",
    "meta"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "elements": [
    "html",
    "base",
    "head",
    "link",
    "meta"
  ]
}
trace
provider did not expose step-level events
98-books-add-to-cart-not PASS 3.5s · $0.0044 PASS 12.8s · $0.0170
instructionFind the first book whose title starts with "The" and return its title and price. Return JSON: { "title": string, "price": string }
{
  "type": "object",
  "properties": {
    "title": {
      "type": "string"
    },
    "price": {
      "type": "string"
    }
  },
  "required": [
    "title",
    "price"
  ]
}
pre.dev browser agent
extracted
{
  "title": "The Requiem Red",
  "price": "£22.65"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "title": "The Requiem Red",
  "price": "£22.65"
}
trace
provider did not expose step-level events
99-jsonplaceholder-todos PASS 3.2s · $0.0101 PASS 12.6s · $0.0260
instructionExtract the titles of the first 3 todos from the JSON response displayed. Return JSON: { "todos": [string] }
{
  "type": "object",
  "properties": {
    "todos": {
      "type": "array",
      "items": {
        "type": "string"
      }
    }
  },
  "required": [
    "todos"
  ]
}
pre.dev browser agent
extracted
{
  "todos": [
    "delectus aut autem",
    "quis ut nam facilis et officia qui",
    "fugiat veniam minus"
  ]
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "todos": [
    "delectus aut autem",
    "quis ut nam facilis et officia qui",
    "fugiat veniam minus"
  ]
}
trace
provider did not expose step-level events
trivial-example-h1 PASS 2.5s · $0.0009 PASS 10.7s · $0.0053
instructionExtract the H1 heading text from the page. Return JSON: { "heading": string }
{
  "type": "object",
  "properties": {
    "heading": {
      "type": "string"
    }
  },
  "required": [
    "heading"
  ]
}
pre.dev browser agent
extracted
{
  "heading": "Example Domain"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "heading": "Example Domain"
}
trace
provider did not expose step-level events
trivial-jsonplaceholder-user PASS 3.1s · $0.0011 PASS 10.7s · $0.0107
instructionExtract the user's name from the JSON response. Return JSON: { "name": string }
{
  "type": "object",
  "properties": {
    "name": {
      "type": "string"
    }
  },
  "required": [
    "name"
  ]
}
pre.dev browser agent
extracted
{
  "name": "Leanne Graham"
}
trace
provider did not expose step-level events
browser use cloud
extracted
{
  "name": "Leanne Graham"
}
trace
provider did not expose step-level events