I have recently pulled multiple JSON files from a SQL database and I would like to load them into my Google Datastore. Can anyone suggest the best way to go about this. I have read the docs and they detail how to create entities but I cannot determine how to do a bulk data load. Any tips or tricks would be welcome.
我最近从SQL数据库中提取了多个JSON文件,我想将它们加载到我的谷歌数据存储中。有谁能提出解决这个问题的最好办法吗?我已经阅读了文档,它们详细介绍了如何创建实体,但我无法确定如何进行大容量数据加载。任何提示或技巧都是受欢迎的。
1 个解决方案
#1
1
Two years later and no answer! The key to doing this right now, in 2017, seems to be the new Dataflow thing in Google Cloud. There are SDKs for both Java and Python, but it's still so new I'm using the Java SDK, the 1.9 version. I've adapted two of the examples and have it putting data into the Datastore. It seems to play nice with namespaces so far, but it's a little difficult to make fields with parent/child relationships.
两年过去了,没有人回答!在2017年,实现这一目标的关键似乎是谷歌云中的新数据流。Java和Python都有SDK,但它仍然是新的,我使用的是1.9版本的Java SDK。我已经修改了两个示例,并将数据放入数据存储中。到目前为止,命名空间看起来还不错,但是要创建具有父/子关系的字段有点困难。
#1
1
Two years later and no answer! The key to doing this right now, in 2017, seems to be the new Dataflow thing in Google Cloud. There are SDKs for both Java and Python, but it's still so new I'm using the Java SDK, the 1.9 version. I've adapted two of the examples and have it putting data into the Datastore. It seems to play nice with namespaces so far, but it's a little difficult to make fields with parent/child relationships.
两年过去了,没有人回答!在2017年,实现这一目标的关键似乎是谷歌云中的新数据流。Java和Python都有SDK,但它仍然是新的,我使用的是1.9版本的Java SDK。我已经修改了两个示例,并将数据放入数据存储中。到目前为止,命名空间看起来还不错,但是要创建具有父/子关系的字段有点困难。