2007-11-18 11:59:42 +00:00
aria2 - The ultra fast download utility
2008-02-26 12:38:45 +00:00
=======================================
:Author: Tatsuhiro Tsujikawa
:Email: tujikawa_at_users_dot_sourceforge_dot_net
2006-02-17 13:35:04 +00:00
2008-02-26 12:38:45 +00:00
Disclaimer
----------
2006-02-17 13:35:04 +00:00
This program comes with no warranty.
You must use this program at your own risk.
2008-02-26 12:38:45 +00:00
Introduction
------------
aria2 is a utility for downloading files. The supported protocols are HTTP(S), FTP, BitTorrent, and Metalink. It has a powerful segmented downloading ability, downloading a file from multiple sources and multiple protocols and utilizing your download bandwidth to the maximum. It supports downloading a file from HTTP(S)/FTP and BitTorrent at the same time, while the data downloaded from HTTP(S)/FTP is uploaded to the BitTorrent swarm. Using Metalink's chunk checksums, aria2 automatically validates chunks of data while downloading a file like BitTorrent.
Here is a list of features.
2006-02-17 13:35:04 +00:00
* HTTP Proxy support
* HTTP BASIC authentication support
* HTTP Proxy authentication support
2006-02-21 15:01:05 +00:00
* FTP support(active, passive mode)
* FTP through HTTP proxy(GET command or tunneling)
2008-02-26 12:38:45 +00:00
* Multi-source/segmented downloading ability
2007-06-10 08:29:56 +00:00
* Cookie support
* It can load cookies from file whose format is used by Netscape and Mozilla.
2006-02-17 13:35:04 +00:00
* It can run as a daemon process.
2008-02-26 12:38:45 +00:00
* BitTorrent protocol support with fast extension, DHT, encryption, PEX enabled.
2007-07-08 02:00:15 +00:00
* Selective download in multi-file torrent/metalink.
2006-08-07 16:47:52 +00:00
* Metalink version 3.0 support(HTTP/FTP/BitTorrent).
2007-11-13 12:08:40 +00:00
* Limits download/upload speed.
2007-03-27 16:38:11 +00:00
* Chunk checksum validation in Metalink.
* netrc support.
* Configuration file support.
2007-11-13 12:08:40 +00:00
* Downloads URIs found in a text file or stdin.
* Integrates HTTP/FTP/BitTorrent downloads; downloading a file from several
different sources.
2006-02-17 13:35:04 +00:00
2008-02-26 12:38:45 +00:00
Dependency
----------
.External Library Dependency
[frame="all", grid="all"]
`---------`---------------------------
features dependency
--------------------------------------
HTTPS GnuTLS or OpenSSL
BitTorrent GnuTLS+Libgcrypt or OpenSSL
Metalink libxml2 or Expat.
Checksum GnuTLS+Libgcrypt or OpenSSL
--------------------------------------
2006-03-27 Tatsuhiro Tsujikawa <tujikawa at rednoah dot com>
* configure.in: Added gnutls support. Added several CPP macros.
* m4/openssl.m4: Added.
* src/SocketCore.{h,cc}: Drop const quarifier from writeData(),
readData(), peekData(). Added gnutls support.
* src/HttpDownloadCommand.cc: Removed SleepCommand.h
* src/TrackerWatcherCommand.{h,cc}: Added. This command creates
TrackerInitCommand periodicaly(TorrentMan::minInterval).
* src/TorrentMan.cc: Remove downloadedSize == 0 check from
save().
Instead, added a check for whether setup method has executed
successfully.
* src/TorrentMan.h: Added member vaiable setupComplete. Updated
DEFAULT_ANNOUNCE_INTERVAL and DEFAULT_ANNOUNCE_MIN_INTERVAL to
300.
* src/Makefile.am: Updated.
* src/messageDigest.h: Added. This is a macro calculating SHA1
digest
using whether OpenSSL or gcrypt, depending on the result of
configure
script.
* src/ShaVisitor.{h,cc}: Removed direct dependency on OpenSSL by
using
messageDigest.h.
* src/TorrentAutoSaveCommand.h: Removed unused variable cuid.
* src/PeerListenCommand.cc: Added log about port binded
successfully.
Fixed memory leak.
* src/main.cc: Added gnutls support. Replaced LIB_SSL with
ENABLE_BITTORRENT where they are not related to OpenSSL but
BitTorrent.
Removed instantiation of TrackerInitCommand. Instead,
TrackerWatcherCommand is instantiated and pushed to the command
queue.
* src/InitiateConnectionCommandFactory.cc: Replaced HAVE_LIBSSL
with
ENABLE_SSL.
* src/Request.cc: Replaced HAVE_LIBSSL with ENABLE_SSL.
* src/RequestSlotMan.cc:
(deleteCompletedRequestSlot)
If a piece is already acquired by another command, delete the
request
slots for the piece.
* src/TrackerUpdateCommand.cc:
(execute)
Changed log level of MSG_TRACKER_WARNING_MESSAGE from info to
warn.
Added a check whether peer list is null.
Fixed the bug that causes sending completed event to the tracker
several times.
* src/TrackerInitCommand.cc:
(execute)
Fixed the bug that causes sending completed event to the tracker
several times.
* src/AbstractDiskWriter.{h,cc}: Removed direct dependency on
OpenSSL
by using messageDigest.h.
2006-03-26 Tatsuhiro Tsujikawa <tujikawa at rednoah dot com>
* PeerConnection.cc: Replaced log message "keep-alive" with
"keep alive".
* PeerInteractionCommand.{h,cc}: Close connection if peer is
choking
localhost long time.
* TorrentMan.cc: When adding new peer with duplicate = true, if
the
number of peer list is equal to or grater than MAX_PEER_LIST,
delete
at most 100 failure entry from the list. If with duplicate =
false,
MAX_PEER_LIST is not checked.
* PeerListenCommand.cc: Fixed the argument order of log message.
2006-03-25 Tatsuhiro Tsujikawa <tujikawa at rednoah dot com>
* Logger.h: Moved enum LEVEL from SimpleLogger.h to here.
Added warn().
* SimpleLogger.h: Moved enum LEVEL to Logger.h.
Implemented warn().
Defined 2 macros(WRITE_LOG, WRITE_LOG_EX) to avoid duplicated
code.
2006-03-27 14:47:26 +00:00
2007-12-14 00:46:32 +00:00
Note;;
GNU TLS has precedence over OpenSSL if both libraries are installed.
If you prefer OpenSSL, run configure with "--without-gnutls".
Note;;
libxml2 has precedence over Expat if both libraries are installed.
If you prefer Expat, run configure with "--without-libxml2".
2006-03-21 15:21:11 +00:00
2006-07-04 11:44:15 +00:00
You can disable BitTorrent, Metalink support by providing --disable-bittorrent,
--disable-metalink respectively to configure script.
2006-08-21 14:36:20 +00:00
In order to enable async DNS support, you need c-ares or ares.
2006-08-14 15:19:11 +00:00
2008-02-26 12:38:45 +00:00
* c-ares: http://daniel.haxx.se/projects/c-ares/
* ares: ftp://athena-dist.mit.edu/pub/ATHENA/ares
How to build
------------
2007-11-13 12:08:40 +00:00
In order to build aria2 from the source package, you need following development
packages(package name may vary depending on the distribution you use):
2008-02-26 12:38:45 +00:00
* libgnutls-dev (Required for HTTPS, BitTorrent, Checksum support)
* libgpg-error-dev (Required for BitTorrent, Checksum support)
* libgcrypt-dev (Required for BitTorrent, Checksum support)
2007-11-13 12:08:40 +00:00
* libares-dev (Required for async DNS support)
* libxml2-dev (Required for Metalink support)
You can use libssl-dev instead of libgnutls-dev,libgpg-error-dev,libgcrypt-dev:
2008-02-26 12:38:45 +00:00
* libssl-dev (Required for HTTPS, BitTorrent, Checksum support)
2007-11-13 12:08:40 +00:00
2007-12-14 00:46:32 +00:00
You can use libexpat1-dev instead of libxml2-dev:
2008-02-26 12:38:45 +00:00
2007-12-14 00:46:32 +00:00
* libexpat1-dev (Required for Metalink support)
2007-11-13 12:08:40 +00:00
The build process is fairly standard way for *nix programs:
2008-02-26 12:38:45 +00:00
-------------
2007-11-13 12:08:40 +00:00
$ ./configure
$ make
2008-02-26 12:38:45 +00:00
-------------
2007-11-13 12:08:40 +00:00
The executable is aria2c in src directory.
2008-02-26 12:38:45 +00:00
BitTorrrent
-----------
About filename
~~~~~~~~~~~~~~
2006-03-21 15:21:11 +00:00
The filename of the downloaded file is determined as follows:
2008-02-26 12:38:45 +00:00
single-file mode::
2006-03-21 15:21:11 +00:00
If "name" key is present in .torrent file, filename is the value of "name"
key. Otherwise, filename is the basename of .torrent file appended by
".file". For example, .torrent file is "test.torrrent", then filename is
"test.torrent.file".
The directory to store the downloaded file can be specified by -d option.
2008-02-26 12:38:45 +00:00
multi-file mode::
2006-03-21 15:21:11 +00:00
The complete directory/file structure mentioned in .torrent file is
created.
The directory to store the top directory of downloaded files can be
specified by -d option.
2006-04-18 17:06:17 +00:00
In the default behavior, before download starts, complete directory structure
is created if needed. Then aria2 opens all files mentioned in .torrent file,
directly writes to and reads from these files.
NOTE: Even in selective download, all files are opened.
If "--direct-file-mapping" option set to be false, aria2 creates temporary
file in the store directory. The length of this file is the sum of length of
the files in .torrent file, so at least 2 times more disk space than the file
size itself is required. Writing and reading is done against this file.
After download completes, aria2 creates complete directory structure if needed,
and copies whole file or a part of it to the destination.
2006-03-24 11:59:18 +00:00
2008-02-26 12:38:45 +00:00
DHT
~~~
As of release 0.13.0, aria2 supports DHT. The routing table is saved to $HOME/.aria2/dht.dat.
Note;;
* -o option is used to change the filename of .torrent file itself, not a filename of a file in .torrent file.
* The port numbers that aria2 uses by default are 6881-6999 for TCP and UDP.
* aria2 doesn't configure port-forwarding automatically. Please configure your router or firewall manually.
2007-06-10 08:29:56 +00:00
* The maximum number of peers is 55. This limit may be exceeded when download
rate is low.
2007-01-28 14:18:35 +00:00
* As of release 0.10.0, aria2 stops sending request message after selective
download completes,
2006-07-04 11:44:15 +00:00
2008-02-26 12:38:45 +00:00
Metalink
--------
2006-08-07 16:47:52 +00:00
The current implementation supports HTTP/FTP/BitTorrent.
The other P2P protocols are ignored.
2006-07-04 11:44:15 +00:00
2007-12-14 00:46:32 +00:00
For checksum checking, MD5, SHA1, SHA256 are supported. If multiple hash
algorithms are provided, aria2 uses SHA1. If checksum checking is failed, aria2
doesn't retry the download and just exits with non-zero return code.
2006-07-04 11:44:15 +00:00
2007-12-14 00:46:32 +00:00
The supported user preferences are version, language, location, protocol and
os.
2007-01-28 14:18:35 +00:00
If chunk checksums are provided in Metalink file, aria2 automatically validate
a chunk of file while downloading it. This behavior can be turned off by
a command-line option.
2007-03-27 16:38:11 +00:00
2008-02-26 12:38:45 +00:00
netrc
-----
2007-03-27 16:38:11 +00:00
netrc support is enabled by default in ftp.
To disable netrc support, specify -n command-line option.
Your .netrc file should have correct permissions(600).
2008-02-26 12:38:45 +00:00
Configuration file
------------------
Configuration file must be placed under $HOME/.aria2 and must be named as aria2.conf.
2007-03-28 16:13:36 +00:00
In each line, there is 1 parameter whose syntax is name=value pair,
where name is the long command-line option name without '--' prefix.
The lines beginning '#' are treated as comments.
2007-03-27 16:38:11 +00:00
2007-03-28 16:13:36 +00:00
Example:
2008-02-26 12:38:45 +00:00
--------------------------------------
2007-03-27 16:38:11 +00:00
# sample configuration file for aria2c
file-allocation=prealloc
listen-port=60000
seed-ratio=1.0
max-upload-limit=40K
ftp-pasv=true
2008-02-26 12:38:45 +00:00
---------------------------------------