Stilio
🦎 A DHT crawler with a minimalistic frontend, written in Python
Install / Use
/learn @seik/StilioREADME
stilio
.. image:: https://travis-ci.org/seik/stilio.svg?branch=master :target: https://travis-ci.org/seik/stilio .. image:: https://readthedocs.org/projects/stilio/badge/?version=latest :target: https://stilio.readthedocs.io/en/latest/?badge=latest .. image:: https://img.shields.io/badge/code_style-black-000000.svg :target: https://github.com/ambv/black .. image:: https://img.shields.io/github/license/seik/stilio :target: https://github.com/seik/stilio/blob/master/LICENSE
|
.. raw:: html
<embed>
<p align="center">
<img src="resources/images/stilio-logo.png">
</p>
</embed>
Goals
- Completely written in python.
- Fast. But never trade code readability for speed.
- Easy set up.
Quickstart
A `docker-compose </docker-compose.yml>`_ file is included to allow a fast and easy set up.
::
docker-compose up
.. note::
For a production enviroment it's recommended to run the frontend and database separated from the
crawler since the last one generates a lot of traffic and can make a poor experience
for the users. You can read a guide about how to do this `here <https://stilio.readthedocs.io/en/latest/stilio/guides.html>`_.
FAQ
~~~
The crawler speed is not so good.
Try to run this commands if you are on linux:
::
iptables -I OUTPUT -t raw -p udp --sport PORT_NUMBER -j NOTRACK
iptables -I PREROUTING -t raw -p udp --dport PORT_NUMBER -j NOTRACK
