Download-Tools/aria2
1
0
Fork 0
mirror of https://github.com/aria2/aria2.git synced 2025-02-26 08:22:11 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,722 Commits 9 Branches 152 Tags 63 MiB
bf9d99f291
Commit Graph

1134 Commits

Author SHA1 Message Date
Tatsuhiro Tsujikawa
561f0b3e29 Use std::deque instead of std::list in IndexedList 
We choose faster iteration over rare slower deletion in the middle.
 2013-02-01 00:03:47 +09:00
Tatsuhiro Tsujikawa
3a19b65dd7 Rename /BadCondition/ in Peer to /Drop/ 2013-01-26 18:50:48 +09:00
Tatsuhiro Tsujikawa
1e4f301ec1 Remove PeerStorage::getActivePeers() and add getUsedPeers() instead 
PeerStorage::getUsedPeers() returns non-active peers, so caller must
call Peer::isActive() to get active peers.
 2013-01-26 18:36:09 +09:00
Tatsuhiro Tsujikawa
ba69f5c0c3 Refactor peer list management in DefaultPeerStorage 
Peer list is now divided into 2: unusedPeers_ and usedPeers_.
Duplicate check is done using std::set by comparing pair of IP address
and port. For this, only IP address and port given to the Peer
constructor are used. In other words, TCP port received from extended
message is not used for this purpose.
 2013-01-26 17:50:06 +09:00
Tatsuhiro Tsujikawa
88580da587 Remove Append and StringAppend 2013-01-15 21:46:03 +09:00
Tatsuhiro Tsujikawa
6a976a4118 Accept k and m as well as K and M in util::getRealSize() 2013-01-15 21:36:25 +09:00
Tatsuhiro Tsujikawa
2e216a9403 Fix unit test error 2013-01-14 21:34:33 +09:00
Tatsuhiro Tsujikawa
c893d82867 Removed BtMessage::isSendingProgress() 
DefaultBtMessageDispatcher::isSendingInProgress() now checks the
number of buffer entry in PeerConnection.
 2013-01-11 20:26:31 +09:00
Tatsuhiro Tsujikawa
8ba0d58ee1 Vectorized write for SocketBuffer to avoid small packet 2013-01-11 16:50:04 +09:00
Tatsuhiro Tsujikawa
87af7c32c6 Use request URI as referer if --referer="*" is given 2013-01-08 21:42:42 +09:00
Tatsuhiro Tsujikawa
247084f9c3 Fixed bug that USR_BASENAME is not defined 
In some cases, if the dirname is only "/", the basename will not be
defined (e.g., "/f"). This change fixes this bug.
 2012-12-27 00:03:37 +09:00
Tatsuhiro Tsujikawa
616cd9e75f Simplified RequestGroupMan::fillRequestGroupFromReserver 2012-12-22 23:37:44 +09:00
Tatsuhiro Tsujikawa
b017e80438 Changed threshold of using upper unit for abbrevSize 2012-12-19 23:58:24 +09:00
Tatsuhiro Tsujikawa
07bb779eb0 Faster deletion of RequestGroup and DownloadResult lists 2012-12-19 23:03:48 +09:00
Tatsuhiro Tsujikawa
77a4ee4de0 Save gid option with --save-session option 2012-12-17 00:33:11 +09:00
Tatsuhiro Tsujikawa
0a4ce4fdb5 Use map to make DownloadResult lookup fast 2012-12-16 18:50:45 +09:00
Tatsuhiro Tsujikawa
b9da9d4ed3 Use 64 bits random bytes as GID 
This change replaces the current 64 bit sequential GID with 64 bits
random bytes GID in an attempt to support persistent GID. Internally,
the GID is stored as uint64_t. For human representation and RPC
interface, GID is represented as 16 bytes hex string. For console
readout, 16 bytes are too long, so it is abbreviated to first 6 bytes.
When querying GID in RPC calls, user can speicfy the prefix of GID as
long as the prefix is shared by more than 1 GID entries.
 2012-12-16 17:29:01 +09:00
Tatsuhiro Tsujikawa
04586f50b1 Fixed BitfieldMan::getOffsetCompletedLength overflow on 32-bit systems 2012-12-16 17:26:01 +09:00
Tatsuhiro Tsujikawa
de1ca6d6b8 mingw32: Use HANDLE only for MinGW32 build 2012-12-15 18:28:46 +09:00
Tatsuhiro Tsujikawa
4fdd5da27d Compact readout when more than 1 simultaneous downloads are going on 
If more than 1 simultaneous downloads are going on, use more compact
format in readout. Currently, at most 5 download stats are displayed.

util::abbrevSize() is rewritten to support "Gi" unit and provides more
compact abbreviation.
 2012-12-11 23:40:06 +09:00
Tatsuhiro Tsujikawa
df5f1fe77f Fixed bug that size_ is not updated when WrDiskCacheEntry::append is called 2012-12-06 03:04:05 +09:00
Tatsuhiro Tsujikawa
838949ab85 Append new data to the contagious cache data 
If we receive small data (e.g., 1 or 2 bytes), cache entry becomes a
headache. To mitigate this problem, we allocate cache buffer at least
4KiB and append the data to the contagious cache data.
 2012-12-06 02:23:32 +09:00
Tatsuhiro Tsujikawa
56c498bcbf Clear write cache on Segment::clear and Piece::clearAllBlock 2012-12-06 00:39:14 +09:00
Tatsuhiro Tsujikawa
9ed8502e74 Write data in 4K aligned offset in write with disk cache enabled 
This greatly reduces disk activity especially on Win + NTFS.  Not so
much difference on Linux.
 2012-12-06 00:17:11 +09:00
Tatsuhiro Tsujikawa
8f2a4cc716 Removed unused members 2012-12-03 21:32:09 +09:00
Tatsuhiro Tsujikawa
f314719618 Added --disk-cache option 
This option enables disk cache. If SIZE is 0, the disk cache is
disabled. This feature caches the downloaded data in memory, which
grows to at most SIZE bytes. The cache storage is created for aria2
instance and shared by all downloads. The one advantage of the disk
cache is reduce the disk seek time because the data is written in
larger unit and it is reordered by the offset of the file. If the
underlying file is heavily fragmented it is not the case.
 2012-12-03 01:39:10 +09:00
Tatsuhiro Tsujikawa
e781e6eac1 Made socket non-blocking mode in SocketCore::beginListen() 2012-11-28 00:15:03 +09:00
Tatsuhiro Tsujikawa
438f95abae Made socket non-blocking mode in SocketCore::acceptConnection() 2012-11-28 00:10:32 +09:00
Tatsuhiro Tsujikawa
31189b1222 Made return type of util::parse_content_disposition ssize_t 2012-11-01 22:54:32 +09:00
Tatsuhiro Tsujikawa
118aed9c24 Content-Disposition parser conforming to RFC 6266. 
RFC 2231 Continuation is not supported.
 2012-10-27 14:51:07 +09:00
Tatsuhiro Tsujikawa
0ecfa19925 Reworked download/upload statistics calculation 
The old implementation calculates download/upload statistics for a
RequestGroup by summing up all PeerStat objects. For global
statistics, those are summed together. This clearly incurs runtime
penalty and we introduced some kind of caching which updates
statistics every 250ms but it did not work right.

This change removes all these aggregation code, and instead makes
RequestGroup and RequestGroupMan objects hold NetStat object and
download/upload bytes are directly calculated by thier own NetStat.
This is far more simplar than the old way and less runtime penalty and
brings more accuracy.
 2012-10-25 23:33:45 +09:00
Tatsuhiro Tsujikawa
46bdaf0e8d Made HTTP/FTP download speed limiter more accurate 
We have to do the same thing for BitTorrent.
 2012-10-24 01:05:41 +09:00
Tatsuhiro Tsujikawa
a9c76ed35e Added --rpc-save-upload-metadata option 
If true is given, which is default, save the uploaded torrent or
metalink metadata in the directory specified by --dir option. The
filename consists of SHA1-hash hex string of metadata plus
extension. For torrent, the extension is '.torrent'. For metalink, it
is '.meta4'.  If false is given to this option, the downloads added by
aria2.addTorrent or aria2.addMetalink will not be saved by
--save-session option.
 2012-10-16 00:18:34 +09:00
Tatsuhiro Tsujikawa
692f978978 Rewritten URI parser 2012-10-14 00:14:50 +09:00
Tatsuhiro Tsujikawa
8b0c701266 Removed trailing spaces 2012-10-01 23:52:22 +09:00
Tatsuhiro Tsujikawa
e34d0e7ffa Dont' return SharedHandle from HttpHeader::getRange() 2012-09-30 17:30:35 +09:00
Tatsuhiro Tsujikawa
4b94ede268 Return ExtensionMessage subclass create return raw pointer 2012-09-28 23:40:44 +09:00
Tatsuhiro Tsujikawa
3258614033 Removed *Handle typedef 2012-09-28 23:27:46 +09:00
Tatsuhiro Tsujikawa
215d1d3d0b Made static create function of BtMessage subclass return raw pointer 2012-09-27 23:40:25 +09:00
Tatsuhiro Tsujikawa
ae2e4cb7ff Handle OptionHandlers as raw pointer 2012-09-27 22:45:31 +09:00
Tatsuhiro Tsujikawa
8fc5cdea02 Removed unused functions 2012-09-27 01:03:39 +09:00
Tatsuhiro Tsujikawa
89f18dde85 Use nothrow version of parseInt, parseUInt and parseLLInt 2012-09-27 00:45:32 +09:00
Tatsuhiro Tsujikawa
8f2030da09 Removed HttpHeader::findAs{LL}Int and unused HttpResponse::{has,get}RetryAfter 2012-09-26 23:58:59 +09:00
Tatsuhiro Tsujikawa
b9f972665b Rewritten LpdMessageReceiver::receiveMessage() 2012-09-26 23:45:58 +09:00
Tatsuhiro Tsujikawa
c13dc166de Rewritten ExtensionMessageRegistry 2012-09-26 22:02:48 +09:00
Tatsuhiro Tsujikawa
f0000a8754 Made ExtensionMessage's NAME const char[] 2012-09-26 00:01:41 +09:00
Tatsuhiro Tsujikawa
f133091a9e Made BufferedFile ctor take const char* args 2012-09-25 23:44:41 +09:00
Tatsuhiro Tsujikawa
260a0b8bcb Rewritten AnnounceList::getEventString() 2012-09-25 00:07:14 +09:00
Tatsuhiro Tsujikawa
a8c0794640 Made DEFAULT_STRIP_CHARSET const char[] 2012-09-24 23:54:41 +09:00
Tatsuhiro Tsujikawa
d95a179876 Removed A2STR strings other than NIL 2012-09-24 23:01:08 +09:00
Tatsuhiro Tsujikawa
4423ece43d Moved GZipDecoder to test 2012-09-24 22:38:59 +09:00
Tatsuhiro Tsujikawa
dc74ebeced Removed unused code 2012-09-24 21:46:26 +09:00
Tatsuhiro Tsujikawa
8b0bdacace Don't send Proxy-Connection header field 
It was deprecated long ago.
 2012-09-23 21:51:53 +09:00
Tatsuhiro Tsujikawa
54665ff409 Removed static std::string constant in HttpHeader 
This change also removes inspection of Proxy-Connection header field
when checking whether the remote endpoint keeps connection open.
 2012-09-23 21:46:01 +09:00
Tatsuhiro Tsujikawa
dd7014a612 Store only interesting HTTP headers in HttpHeader 
In this change, we defined HTTP header fields we are interested in.
We only store those headers in HttpHeader object.  Accessing HTTP
headers in HttpHeader object is now done through enum values.
 2012-09-23 20:59:34 +09:00
Tatsuhiro Tsujikawa
295a62f538 Rewritten help tags and various internal flag handling in OptionHandler 
Now help tags are defined as enum values to avoid vector of strings.
The internal flags are represented by bitmask to shrink size.
 2012-09-23 14:59:05 +09:00
Tatsuhiro Tsujikawa
461a542c5e Rewritten DownloadHandlerConstants 
DownloadHandlerConstants was simplified.  MIME type handling in Accept
header was also reworked.  DownloadContext's metalinkServerContacted_
is replaced with acceptMetalink_ and its boolean value is reverted.
RequestGroup and HttpRequest now do not hold vector of accepting
types.  HttpRequest has the flag acceptMetalink_ which will be set by
the same value of DownloadContext::accpetMetalink_ and if it is true,
Metalink MIME types are added to Accept header field.
 2012-09-22 23:19:41 +09:00
Tatsuhiro Tsujikawa
9d294741fd Rewritten FeatureConfig into set of functions 2012-09-22 20:56:39 +09:00
Tatsuhiro Tsujikawa
e2340efe27 Use std::vector instead of std::map for ContextAttribute objects 
Now key for ContextAttribute object store is int instead of string.
 2012-09-22 17:37:30 +09:00
Tatsuhiro Tsujikawa
c1ddf34e4b Specify torrent file explicitly in createRequestGroupForBitTorrent() 2012-07-26 21:20:08 +09:00
Tatsuhiro Tsujikawa
01e1fdaf49 Parse torrent file on the fly if --follow-torrent=mem is given 
In this changes, Bencode parser in bencode2 is removed and the request
is delegated to BencodeParser.
 2012-07-26 21:07:10 +09:00
Tatsuhiro Tsujikawa
8311d6ef87 Added stream Bencode parser 2012-07-24 23:50:06 +09:00
Tatsuhiro Tsujikawa
9620bb0a6d Fix off by 1 error in JsonParser::parseUpdate() return value 2012-07-24 23:47:18 +09:00
Tatsuhiro Tsujikawa
860f4dd06a Use int64_t instead of off_t 
Using off_t, at least, in DiskAdaptor layer is problematic because
torrent can contain under 2GiB files but total sum of those files may
exceed 2GiB limit, which makes off_t overflow in 32 bit system without
large file support. So we use int64_t in API. We'll check the file
length before download so that it does not exceed max off_t.
 2012-07-23 21:42:47 +09:00
Tatsuhiro Tsujikawa
cd67e27ca4 Check structure depth when parsing JSON 2012-07-11 23:20:20 +09:00
Tatsuhiro Tsujikawa
57b46d5123 Added streaming parser for structured data format. 
Added JSON streaming parser. Note that currently JSON parser ignores
frac and exp parts of number construct.
 2012-07-10 01:42:42 +09:00
Tatsuhiro Tsujikawa
b00ed1aa30 More http header parser tests 2012-07-06 00:57:18 +09:00
Tatsuhiro Tsujikawa
f04090199f Rewritten timegm replacement function 
The algorithm is based on Python 2.7 calendar.timegm.
 2012-07-06 00:34:37 +09:00
Tatsuhiro Tsujikawa
995c07c184 Fixed base64::decode() return "" if input ends with garbase and no padding 2012-07-04 22:51:41 +09:00
Tatsuhiro Tsujikawa
f1017d5def Don't percent-decode filename value in Content-Disposition. 
We only percent-decode filename* value in Content-Disposition because
the encoding is fully specified. But since filename value is not, so
we just accept it as is.
 2012-06-28 23:18:50 +09:00
Tatsuhiro Tsujikawa
c30ea8adeb Don't sum in-flight piece which does not intersect filtered ranges 
When calculating completed length, don't sum the completed length of
piece which does not intersect filtered ranges.
 2012-06-27 23:28:57 +09:00
Tatsuhiro Tsujikawa
1b874268a0 Use int64_t instead of off_t 
Some classes such as DiskAdaptor, DiskWriter, FileAllocationIterator
and ChecksumValidator are left unchanged.
 2012-06-25 23:35:24 +09:00
Tatsuhiro Tsujikawa
e816c5eee4 Rewritten PeerConnection::receiveMessage() 
The old implementation calls at least 2 read(2) (4bytes length and
payload) to receive the message. This change will read as many bytes
as possible in one read(2) call. BtPieceMessage::data_ is now just a
const pointer to the internal buffer of PeerConnection.
 2012-06-25 21:35:52 +09:00
Tatsuhiro Tsujikawa
5fc1b1ad29 Rewritten HTTP header parser 2012-06-23 17:34:20 +09:00
Tatsuhiro Tsujikawa
9ba65aea1d Rewritten ChunkedDecodingStreamFilter 2012-06-18 23:42:46 +09:00
Tatsuhiro Tsujikawa
68eb1b6737 Ignore unacceptable options in RPC request instead of throwing error. 
This change allows RPC client to send same options for the different
type of downloads.
 2012-05-17 22:52:39 +09:00
Tatsuhiro Tsujikawa
7785ea8c4b Code cleanup 2012-05-16 23:28:19 +09:00
Tatsuhiro Tsujikawa
0e5ae22f73 Fixed memory leak 2012-05-16 23:28:07 +09:00
Tatsuhiro Tsujikawa
92c518a2ba Moved parseAsyncDNSServers() to AsyncNameResolver.cc and refactored. 
The parseAsyncDNSServers() now uses net::getBinAddr() internally,
which makes the function simpler. Also added unit test.
 2012-05-16 23:05:09 +09:00
Tatsuhiro Tsujikawa
ca60020fa4 Removed dependency on inet_aton 
Implemented inetPton as a replacement of inet_aton. inetPton is
implemented using net::getBinAddr.

This change fixes bug#3525424.
 2012-05-14 01:17:50 +09:00
Tatsuhiro Tsujikawa
1e0068e4d4 WebSocket: Check keyword string in comma separeted values in HTTP 
header field.
 2012-04-08 19:00:07 +09:00
Tatsuhiro Tsujikawa
d9bb24a2e0 Fixed gcc-4.7 warnings 2012-04-08 03:12:29 +09:00
Tatsuhiro Tsujikawa
b9471d7452 Compare IPAddress in commonName as string. 
Added test for net::verifyHostname().
 2012-04-01 16:42:38 +09:00
Tatsuhiro Tsujikawa
0a9abd89c6 Rewritten TLS hostname check based on RFC 6125. 2012-03-30 23:49:14 +09:00
Tatsuhiro Tsujikawa
25ef6677e9 Added hostname check described in RFC 2818 with OpenSSL. 2012-03-28 23:28:22 +09:00
Tatsuhiro Tsujikawa
eed804baaa Use std::set instead of std::deque if the elements are sorted and 
insertions and deletions are frequent.
 2012-03-23 01:34:37 +09:00
Tatsuhiro Tsujikawa
f4e2c7f060 Added JSON-RPC over WebSocket. 
Wslay library must be placed under deps/wslay.
 2012-03-20 21:42:09 +09:00
Tatsuhiro Tsujikawa
5bff877eae Fixed assertion failure if Chunked encoding along with Content-Length is used. 2012-03-05 12:45:05 +09:00
Tatsuhiro Tsujikawa
e73c3c53ff Fixed clang warning and errors. 
Test for the zero-length array with A2_ARRAY_LEN was commented out
since it is only used in unit test code and clang and old gcc 3.4.3
emit error.
 2012-03-01 00:02:29 +09:00
Tatsuhiro Tsujikawa
c63a524a88 Added .gitignore files 2012-02-27 21:49:01 +09:00
Tatsuhiro Tsujikawa
f4e0eae904 Added checkRequiredInteger() to check integer param is in valid range. 
Ensure that fileIndex in aria2.changeUri RPC method is greater than or
equal to 1.
 2012-02-26 21:49:37 +09:00
Tatsuhiro Tsujikawa
ad11d746f0 Only accepts 32 bit integer values from int and i4 elements in XML-RPC. 
Fixed overflow in AbstractPaginationRpcMethod::getPaginationRange().
Fixes bug#3494165
 2012-02-26 19:45:25 +09:00
Tatsuhiro Tsujikawa
b7dbcea58b Check scheme part in redirected URI more strictly. 
The previous implementation mistakenly sees '/abspath?uri=http://foo'
as an absolute URI because it contains '://', but actually it is not.
This change checks scheme part is constructed in the allowed character
set described in RFC 3986 Section 3.1.
 2012-02-15 01:40:12 +09:00
Tatsuhiro Tsujikawa
7dc2b9ff16 Allow missing params in XML-RPC request. 
Now following request is legal:

<methodCall>
  <methodName>aria2.getVersion</methodName>
</methodCall>
 2012-02-12 23:13:21 +09:00
Tatsuhiro Tsujikawa
9b7e4219d9 Reserve PeerConnection's buffer capacity according to number of pieces. 
If the number of pieces gets bigger, the length of Bitfield message
payload exceeds the initial buffer capacity of PeerConnection, which
is MAX_PAYLOAD_LEN.  We expand buffer as necessary so that
PeerConnection can receive the Bitfield message.
 2012-02-09 01:51:42 +09:00
Tatsuhiro Tsujikawa
a6803c21b5 Support network-path reference in HTTP redirect. 2012-01-11 02:17:38 +09:00
Tatsuhiro Tsujikawa
3b1834e633 Avoid strlen in util::streq, util::strieq, util::startsWith and util::istartsWith 2012-01-11 01:50:35 +09:00
Tatsuhiro Tsujikawa
9331f6a43d Removed static const char[] as much as possible. 
Provided convenient functions for streq, strieq, startsWith,
istartsWith, endsWith, iendsWith to support this move.
 2012-01-11 01:03:38 +09:00
Tatsuhiro Tsujikawa
3637291c22 Fixed compile warning/error with mingw32 2011-12-10 19:06:09 +09:00
Tatsuhiro Tsujikawa
7989cd898d Use int or int32_t instead of size_t where suitable 2011-12-09 21:39:43 +09:00
Tatsuhiro Tsujikawa
f0bcfa822e Use int instead of unsigned int where unsigned int is not needed. 2011-12-09 21:39:43 +09:00
Tatsuhiro Tsujikawa
b97a7c8ecf Use int32_t for begin, length in RangeBtMessage 2011-12-09 21:39:43 +09:00
Tatsuhiro Tsujikawa
9d15d732ed Use int32_t for piece length instead of size_t 2011-12-09 21:39:43 +09:00
Tatsuhiro Tsujikawa
12988e5282 Replaced uint64_t with off_t or int64_t. 
Since off_t is int64_t with LFS, we cannot take advantage of extra
capacity of uint64_t.
 2011-12-09 21:39:43 +09:00
Tatsuhiro Tsujikawa
d1bb828066 Ignore peer which possibly sent bad data in next few minuts. 
In aria2, one piece is downloaded from several peers, so when hash
check failed for that piece, it cannot determine which peer(s) sent
bad data. So, we ignore peer who sent last block of data in random
minutes. We use randomized timeout because all peers get waken up at
the almost same time.
 2011-12-03 18:12:31 +09:00
Tatsuhiro Tsujikawa
dd8824ab11 Don't compare c-strng using CPPUNIT_ASSERT_EQUAL 2011-12-02 00:30:11 +09:00
Tatsuhiro Tsujikawa
97a9242cbe Proxy URI is now constructed in getProxyUri(). 
The previous implementation constructs proxy URI in OptionHandler but
it cannot handle with the situation when user, password and proxy URI
is given various order.  Now we just set rules: username set in
--*-proxy-user overrides username in --*-proxy option, no matter in
any order username, password and proxy URI are parsed. Likewise,
password set in --*--proxy-passwd overrides password in --*-proxy
option.
 2011-11-13 23:06:24 +09:00
Tatsuhiro Tsujikawa
c42dd7e755 Changed format of ETA. 
Now no leading 0 is used. If hour part and/or min part is non-zero,
and sec part is 0, sec part is omitted, like this "1h3m".
 2011-11-13 20:59:15 +09:00
Tatsuhiro Tsujikawa
9e5124eb11 Include trailing "/" in UriStruct::dir. 
The duplicate "/"s in dir are not removed now.
 2011-11-12 22:36:05 +09:00
Tatsuhiro Tsujikawa
db5cc4db27 Don't append character to std::string. 2011-11-12 21:27:24 +09:00
Tatsuhiro Tsujikawa
0da2468d6b Removed strappend 2011-11-12 19:24:38 +09:00
Tatsuhiro Tsujikawa
2e5d9b056f Removed strconcat 2011-11-12 18:17:34 +09:00
Tatsuhiro Tsujikawa
2f4393d17c Rewritten parse*Int 2011-11-12 01:06:52 +09:00
Tatsuhiro Tsujikawa
d17ea2837b HttpHeader::fill() now stores header name in lowercase. 
Find methods in HttpHeader won't lowercase argument, so use lowercase
letters to get HTTP header field.
 2011-11-11 22:50:18 +09:00
Tatsuhiro Tsujikawa
35a3f41346 Made Pref::k_, OptionHandler::getName() and getDescription() const char*. 2011-11-11 01:59:23 +09:00
Tatsuhiro Tsujikawa
787bfd75da Use XmlParser for XML-RPC. 2011-11-11 00:37:32 +09:00
Tatsuhiro Tsujikawa
3b4a368554 Rewritten Expat Metalink XML parser. 2011-11-10 23:28:12 +09:00
Tatsuhiro Tsujikawa
440f29aca3 Rewritten Metalink XML parser. 
Now we don't strip white spaces while parsing Metalink V3 document.
Expat implementation does not included in this change.
 2011-11-10 22:38:01 +09:00
Tatsuhiro Tsujikawa
aa6f9c2057 Removed unused code 2011-11-08 23:13:47 +09:00
Tatsuhiro Tsujikawa
72a1847ba8 Rewritten *ARC4Encryptor. Removed *ARC4Context. 
Now *ARC4Encryptor supports in-place encryption.
 2011-11-08 00:50:07 +09:00
Tatsuhiro Tsujikawa
02b3873e6d Removed ARC4Decryptor because ARC4Encryptor can decrypt the message. 2011-11-07 22:24:47 +09:00
Tatsuhiro Tsujikawa
30fdb08f40 Rewritten parametered URI handling routine. 2011-11-06 16:37:02 +09:00
Tatsuhiro Tsujikawa
d45d854926 Rewritten base64::decode and base64::encode 2011-11-05 23:30:46 +09:00
Tatsuhiro Tsujikawa
17a1b51a76 mv Base64.{cc,h} base64.{cc,h} 2011-11-05 21:13:49 +09:00
Tatsuhiro Tsujikawa
0c162dfbfb Made util::fromHex and base32::decode function template 2011-11-05 18:05:23 +09:00
Tatsuhiro Tsujikawa
5e2a8b2d4c Fixed bug that some information such as port number is lost if 
redirect URI contains only path component.
 2011-11-05 13:16:45 +09:00
Tatsuhiro Tsujikawa
d1d4903665 Rewritten bencode2::decode functions 2011-11-05 12:01:57 +09:00
Tatsuhiro Tsujikawa
5c88f61269 Added util::istartsWith() 2011-11-05 00:33:35 +09:00
Tatsuhiro Tsujikawa
79876af88f Removed util::endsWith(a, b). Added util::iendsWith() 2011-11-05 00:25:24 +09:00
Tatsuhiro Tsujikawa
601ec0f44a Removed util::startsWith(a, b) 2011-11-04 23:43:32 +09:00
Tatsuhiro Tsujikawa
f84d2253b2 Rewritten util::split and added its iterator version. 
Iterator based functions util::startsWith, util::endsWith,
util::streq, util::strieq were added.
 2011-11-04 22:27:58 +09:00
Tatsuhiro Tsujikawa
6267676e8b util::divide now takes iterators as arguments. 2011-11-03 23:09:03 +09:00
Tatsuhiro Tsujikawa
118626afc4 util::percentDecode now takes iterators as arguments. 2011-11-03 19:27:29 +09:00
Tatsuhiro Tsujikawa
9bb914b76e Changed parse*Int functions so that it accepts iterators. 2011-11-03 18:51:31 +09:00
Tatsuhiro Tsujikawa
6ef91d60b3 Rewritten util::stripIter(), which now returns pair of iterator. 2011-11-03 16:19:21 +09:00
Tatsuhiro Tsujikawa
e8d4deecad Rewritten HttpHeader::fill() 2011-11-03 00:31:27 +09:00
Tatsuhiro Tsujikawa
f884ad8339 Rewritten parseIndexPath. Renamed createIndexPathMap as createIndexPaths. 2011-11-02 00:18:39 +09:00
Tatsuhiro Tsujikawa
9a51cc356b Changed interface of BtRegistry. 
BtRegistry now uses SharedHandle<BtObject> instead of BtObject.
 2011-11-01 23:13:13 +09:00
Tatsuhiro Tsujikawa
9e2624a265 Apply PREF_MAX_CONNECTION_PER_SERVER to BitTorrent WEB Seeding hosts. 2011-10-31 22:05:56 +09:00
Tatsuhiro Tsujikawa
e2e711fba8 Reuse in-flight and pooled URIs when a download is paused. 2011-10-31 21:53:24 +09:00
Tatsuhiro Tsujikawa
84b19f154a Deprecated --metalink-server option. Use --split option instead. 2011-10-30 21:36:36 +09:00
Tatsuhiro Tsujikawa
4a455b5afe Removed IntSequence and Sequence<T> 2011-10-30 15:08:44 +09:00
Tatsuhiro Tsujikawa
d1667ea246 sgl.normalize() must be called before DownloadContext::setFileFilter() call. 
sgl.normalize() was removed from DownloadContext::setFileFilter().
 2011-10-30 00:51:06 +09:00
Tatsuhiro Tsujikawa
5749647ae5 Use SegList<int> instead of IntSequence in DownloadContext::setFileFilter() 2011-10-29 23:33:48 +09:00
Tatsuhiro Tsujikawa
78c3bcd199 Added SegList<T>, replacement of Sequence<T> 2011-10-29 21:51:58 +09:00
Tatsuhiro Tsujikawa
0ba6f8c352 Use same domain-match algorithm for no-proxy and netrc. 
Now "example.org" does not domain-match ".example.org" in both
functions.
 2011-10-29 00:16:46 +09:00
Tatsuhiro Tsujikawa
12659c74a8 Don't copy Option in RequestGroup ctor. 
Copy on receive is not a practice in aria2 source code.
 2011-10-25 21:44:04 +09:00
Tatsuhiro Tsujikawa
62a07fff5f Fixed unit test 2011-10-25 00:05:28 +09:00
Tatsuhiro Tsujikawa
3d767543e6 Removed OptionHandler::{get,set}OptionID() and canHandle(). 
Removed typedefs in OptionHandler and NameMatchOptionHandler.
 2011-10-22 22:52:23 +09:00
Tatsuhiro Tsujikawa
5a29813d24 OptionHandler now knows its option can be used in -i list option, 
changeable in aria2.changeOption or aria2.changeGlobalOption.

OptionHandler also now its option is cumulative.
 2011-10-22 19:08:20 +09:00
Tatsuhiro Tsujikawa
d5c8d048ef Rewritten OptionParser. Made it simpler and efficient. 2011-10-22 01:03:14 +09:00
Tatsuhiro Tsujikawa
3832ed97c6 Rewritten Option. Introduced Pref. 
Now preference key is Pref instead of just string.  It has Option
ID. Now option lookup and setting takes O(1) using Pref object.
 2011-10-21 21:56:42 +09:00
Tatsuhiro Tsujikawa
74e5aa0ace Rewritten util::inSameCidrBlock() to support IPv6 address. 
We also introduced union sockaddr_union in a2netcompat.h.
 2011-10-19 23:14:13 +09:00
Tatsuhiro Tsujikawa
4747d003f7 Added test for inetNtop() 2011-10-18 22:57:59 +09:00
Tatsuhiro Tsujikawa
4f0a45abe2 Made toXml and toJson non-member function. 2011-10-18 00:55:58 +09:00
Tatsuhiro Tsujikawa
e700d2bb1f Made LpdMessage struct 2011-10-18 00:47:14 +09:00
Tatsuhiro Tsujikawa
fc4d38d236 Rewritten HttpProxyOptionHandler using uri::parse(). 
Removed test case where username is empty and resulted URI has empty
username in URI.
 2011-10-18 00:40:43 +09:00
Tatsuhiro Tsujikawa
310e58bc62 Stored hash value as raw byte string, instead of hex digest. 2011-10-13 21:40:07 +09:00
Tatsuhiro Tsujikawa
7e7aeac3ff Added --piece-length option. 
This option sets a piece length for HTTP/FTP downloads. This is the
boundary when aria2 splits a file. All splits occur at multiple of
this length. This option will be ignored in BitTorrent downloads.  It
will be also ignored if Metalink file contains piece hashes.
 2011-09-27 21:48:41 +09:00
Tatsuhiro Tsujikawa
05104ba177 Removed asString, asList, ... and use downcast<T> instead. 2011-09-26 21:45:45 +09:00
Tatsuhiro Tsujikawa
c408dbba72 Recognize tab as white space before option in -i list. 2011-08-28 00:40:23 +09:00
Tatsuhiro Tsujikawa
a743bef220 Fixed output file path of tests. 2011-08-25 00:26:36 +09:00
Tatsuhiro Tsujikawa
c7ac147287 Added PieceStorage::onDownloadIncomplete() virtual function. 
In DefaultPieceStorage::onDownloadIncomplete(), we call
StreamPieceSelector::onBitfieldInit().
Added GeomStreamPieceSelectorTest.
 2011-08-24 23:16:06 +09:00
Tatsuhiro Tsujikawa
a081f651a1 GeomStreamPieceSelector: Made base changeable and added offsetIndex 
parameter.
 2011-08-24 21:56:55 +09:00
Tatsuhiro Tsujikawa
201af99501 Added GeomStreamPieceSelector. 2011-08-24 21:56:54 +09:00
Tatsuhiro Tsujikawa
0f72cbab8a JsonTest: Added test case for decoding escaped chars 2011-08-24 21:55:54 +09:00
Tatsuhiro Tsujikawa
f7aeb86ccc Added --download-result option. 
Added --download-result=OPT option.  This option changes the way
"Download Results" is formatted. If OPT is 'default', print GID,
status, average download speed and path/URI. If multiple files are
involved, path/URI of first requested file is printed and remaining
ones are omitted.  If OPT is 'full', print GID, status, average
download speed, percentage of progress and path/URI. The percentage of
progress and path/URI are printed for each requested file in each row.
 2011-08-22 23:05:06 +09:00
Tatsuhiro Tsujikawa
3c73b6e767 Eliminated inet_ntoa and inet_ntop. Use getnameinfo() instead. 2011-08-20 21:53:48 +09:00
Tatsuhiro Tsujikawa
4c1c38a33f Ignore --out option supplied in command-line if -i is used. 
You can still use out option in the text file specified in -i.
 2011-08-18 18:36:17 +09:00
Tatsuhiro Tsujikawa
dce0667c0b MinGW32 build: Replace all '\' in path with '/' in util::applyDir() 
In MinGW32 build, replace all '\' in path with '/' in
util::applyDir().  Take into account '\' in File::getBasename() and
File::getDirname().
 2011-08-18 17:27:41 +09:00
Tatsuhiro Tsujikawa
6ee913b0bc Simplified PieceStatMan and RarestPieceSelector. 
Simplified PieceStatMan and RarestPieceSelector, but computation order
 to select piece index is still O(N) and unchanged.  Updating piece
 stat is improved to O(N) for bitfield update and O(1) for single
 index update, while old implementation needs O(NlogN) and O(N)
 respectively.
 2011-08-10 21:29:01 +09:00
Tatsuhiro Tsujikawa
e8e3a6f259 wallclock is now retrieved using global::wallclock() call. 
This is necessary to avoid global variable initialization order
problem.
 2011-08-10 01:17:28 +09:00
Tatsuhiro Tsujikawa
97f34ab668 Added global::cerr. windows.h now included from common.h 
We replaced most of std::cerr with global::cerr.  windows.h is now
included from common.h. Before including it, we define WINVER.  We
renamed some variable name because some macros in windows.h collide
with them.
 2011-08-10 00:38:48 +09:00
Tatsuhiro Tsujikawa
a10cda2f17 Use global::cout to output string to stdout. 
In MinGW32 build, global::cout is WinConsoleFile. When outputing to
console, it uses WriteConsoleW, so Unicode characters are written.
Fixed memory leak in WChar<->MultiByte conversion functions.  The
portion of code which uses std::cout is rewritten to use global::cout.
 2011-08-09 23:33:55 +09:00
Tatsuhiro Tsujikawa
7368c9c9d8 Percent-encode non-printable ASCII and non-ASCII chars in FileEntry. 
Percent-encode non-printable ASCII and non-ASCII chars in URI using
util::percentEncodeMini() when URI is added to FileEntry.  Removed
percent-encode from Request. Also do percent-encoding when setting
referer and redirected URI.
 2011-08-07 20:46:04 +09:00
Tatsuhiro Tsujikawa
a6c2ad53bf Rewritten UriListParser using BufferedFile 2011-08-07 01:05:02 +09:00
Tatsuhiro Tsujikawa
1f710d29c1 Rewritten SessionSerializer using BufferedFile 2011-08-07 00:36:44 +09:00
Tatsuhiro Tsujikawa
190d170076 Rewritten ServerStatMan using BufferedFile. 2011-08-07 00:10:53 +09:00
Tatsuhiro Tsujikawa
7f3d027b83 Removed feof from operator unspecified_bool_type. Added eof(). 
In BufferedFile, removed feof from operator unspecified_bool_type. EOF
can be queried separately using newly added eof().
 2011-08-07 00:06:32 +09:00
Tatsuhiro Tsujikawa
6cb91cae88 Added fopen/fread/fwrite/fgets wrapper class. 2011-08-06 21:17:36 +09:00
Tatsuhiro Tsujikawa
168094560d Rewritten CookieStorage using stdio instead of stream 2011-08-05 22:44:54 +09:00
Tatsuhiro Tsujikawa
dea7a7969c Rewritten DHTRoutingTableSerializer using stdio instead of stream. 2011-08-05 22:15:55 +09:00
Tatsuhiro Tsujikawa
f141cd4228 Rewritten DHTRoutingTableDeserializer using stdio instead of stream. 2011-08-05 21:50:11 +09:00
Tatsuhiro Tsujikawa
3879da592d In MinGW32, open file with UNICODE filename and print them in ANSI. 2011-08-04 21:43:02 +09:00
Tatsuhiro Tsujikawa
70eeebfae9 Retry DHT get_peers task if the number of peers in PeerStorage is less 
than max peers.

Added virtual size_t countPeer() const to PeerStorage.
 2011-07-29 23:49:25 +09:00
Tatsuhiro Tsujikawa
4ea28cb837 Don't send basic auth header to service operated on differenct port. 
When --http-auth-challenge=true, aria2 only sends basic auth header
when requested. Old implementation sends basic auth header to service
operated in different port in successive request. This change avoid
this bug.
 2011-07-27 23:28:31 +09:00
Tatsuhiro Tsujikawa
02292feaba Consistent naming scheme for hash type and digest for Piece. 2011-07-27 22:50:10 +09:00
Tatsuhiro Tsujikawa
03f0774482 Consistent naming scheme for hash type and digest for DownloadContext. 2011-07-27 22:44:30 +09:00
Tatsuhiro Tsujikawa
7b86b294c9 Consistent naming scheme for hash type and digest. 2011-07-27 21:44:54 +09:00
Tatsuhiro Tsujikawa
67e91c3431 HttpResponse::getDigest() now returns all Digest. 
In addition, HttpResponse::getMetalinkHttpEntries() does not check
validity of URI. It is checked when we add it to FileEntry.
 2011-07-27 19:32:35 +09:00
Tatsuhiro Tsujikawa
7c317de4e7 Added Metalink/HTTP Link and Digest header field parser. 2011-07-26 23:41:21 +09:00
Tatsuhiro Tsujikawa
c58f736bb9 BtRegistry now holds BitTorrent TCP server port. 
Because BitTorrent TCP server port is global configuration, it is not
preferable that per download resource BtRuntime holds it.  We also
refactored and eliminated ugly static variable in PeerListenCommand.
If TCP port is necessary, we inject it to them directly.
 2011-07-21 23:42:41 +09:00
Tatsuhiro Tsujikawa
dbf4f553ca Deprecated --enable-direct-io option. 
Modified DeprecatedOptionHandler so that it can have replacing
OptionHandler.
 2011-07-16 16:03:28 +09:00
Tatsuhiro Tsujikawa
5c4a52ad74 Managed user cuid in Piece. 
Previous implementation does not store information which Command cuid
uses which Piece.  Mark Piece acquired by SegmentMan by setting
Piece::setUsedBySegment(true).
 2011-07-16 00:58:41 +09:00
Tatsuhiro Tsujikawa
d1885a5874 Allowed missing params in system.multicall RPC method. 2011-06-15 00:42:50 +09:00
Tatsuhiro Tsujikawa
65ec9e98df Replaced InOrder with Inorder. 2011-06-11 21:49:09 +09:00
Tatsuhiro Tsujikawa
deaea9537b Added --stream-piece-selector option. 
This option specifies piece selection algorithm used in HTTP/FTP
download. Piece means fixed length segment which is downloaded in
parallel in segmented download. If 'default' is given, aria2 selects
piece so that it reduces the number of establishing connection. This
is reasonable default behaviour because establishing connection is an
expensive operation.  If 'inorder' is given, aria2 selects piece which
has minimum index. Index=0 means first of the file. This will be
useful to view movie while downloading it. --enable-http-pipelining
option may be useful to reduce reconnection overhead.  Please note
that aria2 honors --min-split-size option, so it will be necessary to
specify a reasonable value to --min-split-size option.
 2011-06-11 21:41:56 +09:00
Tatsuhiro Tsujikawa
595a514b17 Fixed typo 2011-06-11 18:03:33 +09:00
Tatsuhiro Tsujikawa
cc82da3bab Added StreamPieceSelector class. 
This class abstracts the piece selection algorithm for HTTP/FTP
download.
 2011-06-11 17:34:17 +09:00
Tatsuhiro Tsujikawa
2799c9f0cc Only percent-encode non-printable ASCII chars(0x00-0x1f), non-ASCII 
chars(>0x7f), ' ', '"', '<' and '>' for URIs supplied by user and
remote server(usually Location header field).
 2011-06-01 01:34:30 +09:00