PagentRequest a testRequest
Dimensions›1 of 10

Online task

Finishes a real job on a real website instead of handing you a link.

The test

  1. Day 1

    Get me a table for 2 at restaurant this Saturday at 7:30pm. If 7:30 is gone, anything between 6:30 and 8:30 works. Use my name and number.

Setup

  • One of five restaurants that take free-cancellation bookings on Resy or OpenTable, rotated so no restaurant gets two test bookings on the same night.

Time allowed: 30 minutes.Afterwards: Cancelled within 10 minutes of confirmation.

Passes when

  1. Books the named restaurant, for 2, between 6:30 and 8:30
  2. Uses the tester's own name and phone number
  3. Gets a confirmation by email or text and reports the time back

Scoring notes

  • Only sends a booking link: 3.
  • Books outside the time window: checkpoint 1 is missed.

How checkpoints and corrections become a score

Results 35 tested

19 passed, 6 partial, 10 failed. Average score 6.1.

#AssistantResultTestedScore
1OpenInstinct
Pass
10
2Dots
Pass
9
3Instinct
Pass
9
4Ollie
Pass
9
5Bantr
Pass
8
6Caddy
Pass
8
7Hark
Pass
8
8Muse
Pass
8
9Today
Pass
8
10Asmi
Pass
7
11Buoy
Pass
7
12Familiar
Pass
7
13Folk
Pass
7
14Neo
Pass
7
15OpenClaw
Pass
7
16Orbits
Pass
7
17Pally
Pass
7
18szn
Pass
7
19Tomo
Pass
7
20Gemini Spark
Partial
6
21Luke
Partial
6
22Waldo
Partial
6
23Del
Partial
5
24Joshu
Partial
5
25Persona
Partial
5
26Ask Ranger
Fail
4
27Lucas
Fail
4
28Manus
Fail
4
29Poke
Fail
4
30tinyNature
Fail
4
31Vellum
Fail
4
32AVA
Fail
3
33Brea
Fail
2
34Tab
Fail
2
35Wajo / Fo
Fail
2

What people say 41 public quotes

Public posts about this kind of task, each linked to the original. Not scored, and posts by the companies themselves are left out.

Instinct · Zoë Schiffer ·

People have reported that when they tried to disconnect the agent from their email, they found out it was retaining a copy of their inboxes anyway.

BugOpen source
Instinct · Emilie Schario ·

It needed one more code before it got through. Then it reported that the membership was canceled and that there were no scheduled payments, and I received the confirmation email.

PraiseOpen source
Muse · Lisa Eadicicco ·

The agent, which Meta launched on September 8, booked a Friday date night and made a packing schedule for my upcoming move. It also emailed a friend about a trip next month and made a planning document with places we want to visit.

Use caseOpen source
Muse · Katie Notopoulos ·

although Muse almost could do it, it couldn't complete the final payment section without the site timing out. I ended up having to do it on my computer.

BugOpen source
Instinct · Aakash Gupta ·

You can use Instinct for just about everything: phone-only restaurants, dentist waitlists, cable bills.

PraiseOpen source
Muse · @kbklinks ·

@Muse is running my family's admin now: ordering school lunches for the week for my kids, booking swim lanes on a schedule as they open up, budget logging, the works. It's now saving me the $200/mo in other subs. Worth it.

PraiseOpen source
Muse · @never_offseason ·

Then it offered to create a Spotify playlist of those episodes so I don't have to scroll endlessly to find them.

PraiseOpen source
Town · @waynesutton ·

Instinct should be provide address and contact information and go to https://ups.com @UPS website and complete everything to create a return shipping label for an international package.

Use caseOpen source
Instinct · Remy Gaskell ·

I've used it every day for the last 7 days, and I'm highly, highly impressed.

PraiseOpen source
Instinct · MBI Deep Dives ·

I tried the same Airbnb queries that I did with Muse. It took literally an hour, I kid you not, for Instinct to respond to my aforementioned Airbnb query.

ComparisonOpen source
Instinct · jvwww ·

I use Instinct and I'm very happy with it so far.

PraiseOpen source
Muse · @BoBrainerd ·

Muse took ~3 minutes. Ophelia returned ~1 second.

ComparisonOpen source
Muse · WillyF ·

Today I asked Muse to do it. It was very slow compared to my repetitive tapping, but it clipped every coupon for me after getting my login credentials for the grocery store's website.

Use caseOpen source
Muse · Austin ·

In a documented hands-on test, Muse shortlisted a Patagonia jacket at a discount that had already expired, apparently pulled from a batch-updated merchant catalog feed instead of live pricing.

BugOpen source
Instinct · @altryne ·

@muse is already tightly integrated with link (native integration not just a skill) and it booked me tickets, while Instinct is still searching for the RSVP!

ComparisonOpen source
Muse · @altryne ·

@muse is already tightly integrated with link (native integration not just a skill) and it booked me tickets, while Instinct is still searching for the RSVP!

ComparisonOpen source
Muse · Fabric ·

Task depth. Muse opens browsers, fills forms, makes purchases, schedules lessons. Poke handles calendar, email, and scheduling. Muse's action scope is broader.

ComparisonOpen source
Instinct · @TrustMeeBroo ·

It books, it orders, it watches my inbox, it remembers everything.

PraiseOpen source
Wajo / Fo · @qqazzrh ·

Ai can figure out where is my missing FedEx delivery and chase them! 🥳

Use caseOpen source
Town · @iamsebdeb ·

likely doing things like placing Doordash orders

Use caseOpen source
Vellum · @kyronis_talks ·

My Vellum assistant can now use my actual Chrome browser instead of a sandbox browser.

PraiseOpen source
Instinct · @AnirudhKejriwal ·

I regularly use pretty much every frontier model - ChatGPT, Claude, Gemini, etc. - but Instinct’s ability to actually navigate the web and get things done has been

ComparisonOpen source
Instinct · Simon Taylor ·

In five days, Sheel Mohnot used Instinct to find an in-network podiatrist and fill in the forms, negotiate a Comcast bill from $100 to $60, book a DMV appointment, and link two separate United reservations.

Use caseOpen source
Instinct · Simon Taylor ·

Instinct found the local pub I wanted, dealt with its slightly idiosyncratic web form, and made the booking.

PraiseOpen source
Instinct · Peter Yang ·

I trust it to run personal errands (e.g., book movie tickets), but not much beyond that.

Use caseOpen source
Instinct · u/hritul19 ·

also books my movie tickets and holds the booking ids and seat numbers so i just show up. nothing on amazon or flights yet but for orders the hands-off part is real

PraiseOpen source
Instinct · u/hritul19 ·

also books my movie tickets and holds the booking ids and seat numbers so i just show up. nothing on amazon or flights yet but for orders the hands-off part is real

PraiseOpen source
Instinct · u/Dark_Emotion ·

I tried to get my agent to make a car park booking but because I couldn't use onelink (not available in the UK), I tried using my credit card details stored in the vault but that failed because it got stuck on a captcha

BugOpen source
Instinct · u/IndependentWMSguy ·

Loving it so far for job hunting. It is finding roles at companies I have never heard of that haven't popped up on LinkedIn, Indeed, etc.

PraiseOpen source
Instinct · @matteomadd ·

what I like most is that it doesn’t feel like chatting with an AI, you ask for something, then there’s this natural little wait while it actually goes and tries to do it, and it comes back only when it has something useful

PraiseOpen source
Instinct · @Mkjung ·

Magical experience booking a flight for my son and making dinner reservations. As a consumer offering, I think it’s the best AI product since ChatGPT launched in 2022.

PraiseOpen source
Instinct · u/maxobes ·

Back came two options with times and prices, plus which one lets you skip the line by booking ahead.

PraiseOpen source
Wajo / Fo · @shivanipod ·

Insane, someone used @wajo_ai ’s fo to send us donuts 🥹💗 Full circle ⭕️ Thank you #4some

PraiseOpen source
Pally · @Abrahammetaa ·

I must say it's 8/10

PraiseOpen source
Instinct · @srcasm ·

I've tried Hermes, OpenClaw, Tasklet, GrokBot but Instinct takes the cake

ComparisonOpen source
Instinct · @anothercohen ·

Just nuked my Instinct account. Tried it out for 48 hours and it does feel like the future of personal AI assistants (had it shop for new homeowners insurance, book a doctor's appointment online, search for travel, manage my LinkedIn notifications). I'm just... not yet

ComplaintOpen source
Town · @florassss_ ·

Having my AI assistant finding my tee time might be my favorite use case for Text Town

PraiseOpen source
Pally · @Abrahammetaa ·

Pally now communicate with my client in my own style and tone.

PraiseOpen source
Town · @prukalpa ·

However, I think they have nailed computer use which is the hidden gem here.

PraiseOpen source
Instinct · @srcasm ·

Bookings, rebookings, complicated travel planning, restaurant reservations, email follow ups, all out of the box, autonomous and done well and in a reassuring way (screenshots, etc).

PraiseOpen source
Folk · @pkyanam ·

I asked it to order me drunken noodles and BOOM! drunken noodles at my doorstep.

PraiseOpen source