Selenext
selenext is a lightweight framework, for multi-threaded(or single threaded) web-scraping/testing using selenium's python bindings. This project includes a WebReader object for the Requests module that lets you read data off web pages using Selenium's simple syntax.
Install / Use
/learn @RattleyCooper/SelenextREADME
selenext is a micro-framework for web automation/scraping using selenium in Python 2 or Python 3. This is currently still in development, however it's possible to write and run your automations within the framework as it is.
Discord
https://discord.gg/x8KC5Xh
Install
Just download this as a .zip and then unzip the selenext directory into
your site-packages folder. Once there is a stable release, there will
be a pip install available. You can also grab the repository and pull
updates from github, just create a symbolic link to the selenext directory
into your python path.
Dependencies
selenext is pretty modular, so you should only need the dependencies for the pieces you are using. For database interaction, install:
- peewee
pip install peewee+ installing peewee's dependencies.
You'll need Selenium for doing any browser automation or web scraping.
- selenium python bindings
pip install selenium
You also need the a Web Driver executable like ChromeDriver
Optional Dependencies
If you want to use the requests module along with BeautifulSoup/lxml
to read the content off a web page using the same API as selenium, you
can use the WebReader class to do so. It only supports reading
information off of a page, so methods like click are not implemented.
To use the WebReader, you will need:
- requests
pip install requests - BeautifulSoup4
- lxml
If you need to spin some text, check out spintax for python!
Once you have the dependencies, you can download this repository and start using it, however you may want to read over the documentation below.
Examples
Check out the documentation for the various parts and pieces in the wiki. API documentation will be coming soon.
Related Skills
imsg
349.0kiMessage/SMS CLI for listing chats, history, and sending messages via Messages.app.
node-connect
349.0kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
oracle
349.0kBest practices for using the oracle CLI (prompt + file bundling, engines, sessions, and file attachment patterns).
lobster
349.0kLobster Lobster executes multi-step workflows with approval checkpoints. Use it when: - User wants a repeatable automation (triage, monitor, sync) - Actions need human approval before executing (s
