All Pro Web Designs > > Learning Tutorials > Artificial Intelligence > GPT4V + Puppeteer = AI agent browse web like human? 🤖
GPT4V + Puppeteer = AI agent browse web like human? 🤖
- January 15, 2024
- Posted by: MainInstructor
- Category: Artificial Intelligence Learning Tutorials
![*](https://i0.wp.com/allprowebdesigns.com/wp-content/uploads/2024/01/1705357419_maxresdefault.jpg?resize=840%2C430&ssl=1)
Video Title: GPT4V + Puppeteer = AI agent browse web like human? 🤖
-
Sale!
Wireless WIFI Repeater Extender Amplifier Booster 300Mbps
$29.99$14.99 Add to cartWireless WIFI Repeater Extender Amplifier Booster 300Mbps
Categories: Electronics, Wi-Fi Router, Wireless Wi-Fi Extender Tags: 300Mbps, 802.11N, Amplifier, Booster, Extender, mobile wi-fi booster, Remote, WIFI, Wireless, Wireless WIFI, Wireless WIFI Repeater, Wireless WIFI Repeater Extender, Wireless WIFI Repeater Extender Amplifier, Wireless WIFI Repeater Extender Amplifier Booster, Wireless WIFI Repeater Extender Amplifier Booster 300Mbps$29.99$14.99 -
Sale!
Full RGB Light Design Gaming Headset Headphones with Mic
$24.99$14.99 Add to cartFull RGB Light Design Gaming Headset Headphones with Mic
Categories: Electronics, Gaming, Gaming Headsets Tags: Design, Full, Full RGB Light Design Gaming Headset, Full RGB Light Design Gaming Headset Headphones, Full RGB Light Design Gaming Headset Headphones with Mic, Gamer, Gaming, Gaming Headset Headphones, gaming headset wireless, Headphone, Headphones, Headset, Light, Mic, Package, RGB$24.99$14.99 -
Sale!
Wireless BlueTooth Multi-Device Keyboard Mouse Combo
$39.99$19.99 Add to cartWireless BlueTooth Multi-Device Keyboard Mouse Combo
Categories: Electronics, Gaming, Gaming Keyboards, Keyboard Mouse Combos Tags: Combo, Keyboard, keyboard mouse combos, Mouse, MultiDevice, Set, WireKeyboard Mouse Combo, Wireless, Wireless BlueTooth Keyboard Mouse Combo, Wireless BlueTooth Keyboard Mouse Combos, Wireless BlueTooth Multi-Device Keyboard Mouse Combo, Wireless BlueTooth Multi-Device Keyboard Mouse Combos$39.99$19.99 -
Sale!
High Back Leather Executive Adjustable Swivel Gaming Chair with Headrest and Lumbar
$199.99$139.99 Add to cartHigh Back Leather Executive Adjustable Swivel Gaming Chair with Headrest and Lumbar
Categories: Gaming, Gaming Chairs Tags: Adjustable, Chair, computer chairs, Desk, Executive, Gaming, Girl, Headrest, High, High Back Leather Executive Adjustable Swivel Gaming Chair, High Back Leather Executive Adjustable Swivel Gaming Chair with Headrest, High Back Leather Executive Adjustable Swivel Gaming Chair with Headrest and Lumbar, High Back Leather Executive Adjustable Swivel Gaming Chairs, Leather, Lumbar, Office, Racing, Swivel$199.99$139.99 -
Sale!
Professional LED Light Wired Gaming Headphones with Noise Cancelling Microphone
$29.99$19.99 Select optionsProfessional LED Light Wired Gaming Headphones with Noise Cancelling Microphone
SKU: N/A Categories: Electronics, Gaming, Gaming Headsets Tags: Cancelling, Gaming, Gaming Headphones with Noise Cancelling Microphone, gaming headset, Headphones, Headset, LED, Light, Mic, Microphone, Noise, Professional, Professional LED Light Wired Gaming Headphones, Professional LED Light Wired Gaming Headphones with Noise Cancelling Microphone, Wired, Wired Gaming Headphones, Wired Gaming Headphones with Noise Cancelling Microphone$29.99$19.99 -
Sale!
Gaming Desk with LED Lights USB Power Outlets and Charging Ports
$349.99$249.99 Select optionsGaming Desk with LED Lights USB Power Outlets and Charging Ports
SKU: N/A Categories: Computer Desk, Gaming, Gaming Desk Tags: and Charging Ports, Charging, Desk, Desks, Gaming, gaming desk with led lights, Gaming Desks with LED Lights, Home, LED, Lights, Monitor, Office, Outlets, Port, Power, Room, Stand, USB, USB Power Outlets, White, Workstation$349.99$249.99 -
Sale!
Wired Mixed Backlit Anti-Ghosting Gaming Keyboard
$99.99$79.99 Add to cartWired Mixed Backlit Anti-Ghosting Gaming Keyboard
Categories: Electronics, Gaming, Gaming Keyboards Tags: Antighosting, Backlit, Blue, brown, Gaming, Gaming Keyboard, gaming keyboards, gaming keyboards and mouse, Keyboard, Laptop, Switch, Wired, Wired Mixed Backlit Anti-Ghosting Gaming Keyboard, Wired Mixed Backlit Anti-Ghosting Gaming Keyboards, Wired Mixed Backlit Gaming Keyboard$99.99$79.99 -
Sale!
Wireless Bluetooth 5.3 ANC Noise Cancellation Hi-Res Over the Ear Headphones Headset
$119.99$59.99 Add to cartWireless Bluetooth 5.3 ANC Noise Cancellation Hi-Res Over the Ear Headphones Headset
Categories: Electronics, Gaming, Gaming Headsets Tags: 5.3 ANC Noise Cancellation Hi-Res Over the Ear Headphones Headset, ANC, Audio, Bluetooth, Cancellation, Ear, Earphone, gaming headset, Headphones, Headset, Hi-Res Over the Ear Headphones Headset, HiRes, Noise, Wireless, Wireless Bluetooth 5.3 ANC Noise Cancellation Hi-Res Headphones, Wireless Bluetooth 5.3 ANC Noise Cancellation Hi-Res Over the Ear Headphones Headset, Wireless Bluetooth 5.3 ANC Noise Cancellation Hi-Res Over the Ear Headphones Headsets$119.99$59.99 -
Sale!
Wired Sports Gaming Headset Earbuds with Microphone
$19.99$9.99 Select optionsWired Sports Gaming Headset Earbuds with Microphone
SKU: N/A Categories: Gaming, Gaming Headsets Tags: Accessories, Earbud, Earphone, Earphones, Gaming, gaming headset with microphone, Headphones, Headset, IOS, Microphone, Sports, Wired, Wired Sports Gaming Headset Earbuds, Wired Sports Gaming Headset Earbuds with Microphone, Wired Sports Headset Earbuds$19.99$9.99 -
Sale!
150W Universal Multi USB Fast Charger 16 Port MAX Charging Station
$49.99$29.99 Add to cart150W Universal Multi USB Fast Charger 16 Port MAX Charging Station
Categories: Charging Stations, Electronics Tags: 150W, 150W Charging Station, 150W Universal Multi USB Charging Station, 150W Universal Multi USB Fast Charger 16 Port MAX Charging Station, 150W Universal Multi USB Fast Charger 16 Port MAX Charging Stations, 150W Universal Multi USB MAX Charging Station, 16 Port MAX Charging Station, 3.5A, Charger, Charging, Fast, laptop charging stations, Max, Multi, Port, Stand, Station, Universal, USB$49.99$29.99
agentgpt
ai
ai agent review
ai agent workforce
ai agents
ai news
ai revolution
ai uncovered
artificial intelligence
autogen
autogpt
autonomous ai agents
chatgpt
gpt4v image
how to build a personal ai agent
langchain
open AI
web ai research agent
what is agent in ai
what is an agent and its types in ai
What AI agent use case do you think it will unlock with browser & computer access? Comment and let me know!
how to build query bot ,it should query from the database like mangodb where the data are stored from the application
Amazing video. I was able to get it to work with the following config
const browser = await puppeteer.launch({
headless:false,
executablePath: '/opt/google/chrome/google-chrome',
userDataDir: '/home/gabriel/.config/google-chrome/Default', // Set user data directory here
args: ['–no-sandbox', '–disable-setuid-sandbox'],
});
but I am using WSL and the UserData doesn't seem to persist. Any guide on how to get it to work using WSL?
Why would you jump back and forth between JavaScript and python? Just pic one or the other this seems super ineffective and inefficient
Do people recommend building an AI agent from scratch using Puppeteer and GPT or using an existing self-operating system like OthersideAI or MultiOn?
Been looking for such approach for while now. Until i see this video , very exciting.
But I also concern over the pricing of GPT-4 vision, I hope other alternative works as well like LlvAa 2 vision or CogVLM & CogAgent
Another great share, cheers!
One request… please consider adding links in the description to the products mentioned in videos; perhaps as affiliate links for yourself. Makes for improved UX for viewers.
Can we use LlaVA?
Is it possible to implement with Llama 2 ?
You are awesome. You should have your own instructional (paid membership) website for all of this.
Can we combine ai with something like ui.vision? Have the ai agent learn how to use ui.vision and then it would be able to control computer and browser
I really appreciate your video, I am wondering if you know a good resource or if you can do a video that walks through how to do this 100% from start to finish using windows and vscode
Video summarized with notes and step by step here: https://docs.google.com/document/d/1bOOU0UV1e1aa2u1knc9m0foIyztaSy3-/edit?usp=drive_link&ouid=104287270544355350511&rtpof=true&sd=true
Did you have trouble getting your chrome profile working with Chrome Canary? That seems to be my only sticking point.
24:28 Having an AI agent spend tokens to check the weather when the same search in Google results in the same reminds me of that robot that is told its whole purpose is to pass the butter.
The subject matter is difficult enough that your atonal pronounciation of English completely alienated me from your message.
There is a way to properly pronounce English and that's not it.
You sound like JiangYang.
Thanks!
How much does each run cost on this?
Can you scrape websites without getting detected?
All I need to know is how I can use this to create a trading bot that can learn and update trading knowledge based on my trades, then it can trade going forward without me
im lost
Can you share the repo link?
mind blowing
Do you thing someone with zero coding ability can build what you've just shown? If not do you build this for people to use?
Great video, found it very interesting and inspiring.
Just throwing this out there: If using OpenCV to drive your annotations, you can annotate coords directly on the image without too much difficulty (to give some guidance for when GPT4V is trying to recommend a location to click). Haven't done this with puppeteer, but I'm sure it can be done 😉
Anybody wanna collab on some experiments in this space? 🙏 Lolol
Congrats on your work, really useful content. Keep it up!
Hey Jason, how would you implement the ability to type into textboxes? They usually do not have text in them, so the AI cannot identify them. This feature would likely be needed to add the ability to do more stuff like order a pizza.
You have been making some of the best videos on this stuff since day one. Always super practical yet very valuable content Jason. Keep it up and glad to see the HubSpot sponser! Esketit
I dont know python. is there an alternative for Js, google didnt help me
This is a really smart and intutive process. Thanks Jason!
Absolutely beautiful! Really appreciate you sharing this insightful video. It's always great to see such valuable content. Thanks for broadening our horizons!