Here in Brazil, the government made an app that you can type in the name of the item, for example "Refined Sugar 2kg" and the app return to you the location of the nearest market that has the cheapest item. It extends to all sort of products, and I'm thinking about creating an app using that database. It is public, so it's not a crime, but they do not list all the products on the screen right away with categories and etc. The app only have a search bar, and that's it. How can I get that database? I thought of an crawler (probably python), but all the crawlers that i see has an webpage as a 'target'. I never programmed mobile, so I don't know if a crawler can do that job. So, what should I study in order to make an tool to extract that information?
在巴西,*制作了一个应用程序,您可以输入项目的名称,例如“精制糖2公斤”,应用程序将返回最近市场中最便宜项目的位置。它扩展到所有类型的产品,我正在考虑使用该数据库创建应用程序。它是公开的,所以它不是犯罪,但它们不会立即在屏幕上列出所有产品的类别等。该应用程序只有一个搜索栏,就是这样。我怎样才能获得该数据库?我想到了一个爬虫(可能是python),但我看到的所有爬虫都有一个网页作为“目标”。我从来没有编写过移动设备,所以我不知道爬虫是否能做到这一点。那么,为了制作提取信息的工具,我应该学习什么呢?
1 个解决方案
#1
2
"How can I get that database? " The legal way would be to just ask them for it. Their database likely has passwords/etc which means it is not meant for public use outside of the functionality that the application you mentioned provides. Are there ways to access this data without asking the owner of the information? Possibly. But to attain the data in any other way then asking for it and receiving it, then my friend you are entering a grey area. A crawler won't be much help for what you're trying to do.
“我怎样才能获得该数据库?”合法的方式就是向他们提出要求。他们的数据库可能有密码/等,这意味着它不适合您提到的应用程序提供的功能之外的公共使用。有没有办法在不询问信息所有者的情况下访问这些数据?有可能。但要以任何其他方式获取数据然后要求并接收它,那么我的朋友你正在进入一个灰色地带。爬虫对您正在尝试的操作没有多大帮助。
#1
2
"How can I get that database? " The legal way would be to just ask them for it. Their database likely has passwords/etc which means it is not meant for public use outside of the functionality that the application you mentioned provides. Are there ways to access this data without asking the owner of the information? Possibly. But to attain the data in any other way then asking for it and receiving it, then my friend you are entering a grey area. A crawler won't be much help for what you're trying to do.
“我怎样才能获得该数据库?”合法的方式就是向他们提出要求。他们的数据库可能有密码/等,这意味着它不适合您提到的应用程序提供的功能之外的公共使用。有没有办法在不询问信息所有者的情况下访问这些数据?有可能。但要以任何其他方式获取数据然后要求并接收它,那么我的朋友你正在进入一个灰色地带。爬虫对您正在尝试的操作没有多大帮助。