2

I'm a social science researcher, and I'm working with data from various public databases of NGO, government, etc. Let's assume that I've got no opportunity to ask the admins for the whole database. However, if I have enough patience, I'm able to download all the data one-by-one. But the size of the DB makes it almost impossible solving the problem with brute-force.

So, is there any way to download a public DB with all of it's components?

Here's an example: http://www.trademap.org/tradestat/Country_SelProductCountry_TS.aspx

You can see the Japanese Live animal import (USD) by the importing countries. Is there a faster way to download all the data for every country and products as well than clicking them one-by-one?

Thank you in advance.

Übel Yildmar
  • 149

2 Answers2

1

I think the best option you have is to download the Excel file it produces.

Then use that file and upload/insert to your database.

Another option would be screen scraping but probably not worth the hassle since they provide you with the Excel file any way

Dave
  • 25,513
0

It looks like the site you mentioned uses an ASP.NET ValueState.

Check out this answer for more information on how to decrypt it.

https://stackoverflow.com/questions/1350216/what-does-the-viewstate-hold

Community
  • 1
Jay M
  • 198