Agreed... it often depends as much on the
site you are downloading from... as your connection.
Servers get whacked by heavy demands suddenly... DNS problems.
Plus every connection usually goes through many other sites... sometimes dozens of "hops" ...before your actual destination.
See here for more:
VisualRoute traceroute: connection test, trace IP address, IP trace, IP address locations