在一个项目中允许的数据集的最大数量

Is there a limit on how many datasets I can create in one BigQuery project? I did not find this limit anywhere mentioned in documentations.

我可以在一个BigQuery项目中创建多少数据集有限制吗?我没有发现文档中提到的这个限制。

I am asking this because I want to create a dataset per day. Under the daily dataset, there will be the same number of tables being created with the daily data. E.g.,

我问这个是因为我想每天创建一个数据集。在每日数据集下，将使用每日数据创建相同数量的表。例如,

dataset_20121101
   - table1
   - table2
dataset_20121102
   - table1
   - table2
...
dataset_201XXXXX
   - table1
   - table2

Also if I want to do a query over a range of datasets, can I do something better than explicitly selecting from every single dataset? For instance,

此外，如果我想对一系列数据集进行查询，我是否可以做一些比从每个数据集中显式选择更好的事情?例如,

select date, sum(price) from 
 dateset_20121101.table1, 
 dateset_20121102.table1,
 dateset_20121103.table1,
 dateset_20121104.table1
 group by date order by date

I guess not, but just try to confirm.

我想没有，不过试着确认一下。

Thanks.

谢谢。

1 个解决方案

#1

1. Datasets per project

1。数据集的每个项目

There is no hard limit to the amount of BigQuery datasets you can create per project. However, if you have created a huge amount, then this might provide some challenge when trying to list, for example, all programmatically. ALso, having hundreds of datasets might not be very easy to navigate in the BigQuery UI. Note also that it looks like the bq command line tool doesn't currently paginate over 50 datasets per project (it only displays the first 50, we'll consider adding pagination functions as a feature request).

每个项目可以创建的BigQuery数据集的数量没有硬性限制。但是，如果您已经创建了大量的数据，那么当您试图以编程的方式列出这些数据时，这可能会带来一些挑战。此外，拥有数百个数据集在BigQuery UI中导航可能不太容易。还要注意的是，bq命令行工具目前似乎没有为每个项目对超过50个数据集进行分页(它只显示前50个数据集，我们将考虑添加分页函数作为特性请求)。

2. Quering over a range of datasets

2。对一系列数据集进行查询。

Explicitly listing each dataset.table combination is currently the only way to specify a query to be run over a range of datasets. However, improved syntax for referencing multiple tables is a very common developer request, so we are exploring improvements (such as possibly selecting a range of tables via a pattern rather than a list). For announcements about new features, sign up for the bigquery-announce list.

显式列出每个数据集。表组合是目前指定在一系列数据集上运行查询的惟一方法。但是，用于引用多个表的改进语法是一个非常常见的开发人员请求，因此我们正在研究改进(例如可能通过模式而不是列表来选择一系列表)。有关新功能的公告，请登录bigqueryannouncement列表。

#1