I have a table with a multi-column primary key (city/state/date) and many more columns of data. I'm looking to get the latest data for each city/state. How do I do that cleanly/efficiently? Right now I can do this by doing a first query to get the list of all the rows I'm trying to fetch, followed by a second query with a massive WHERE clause:
我有一个包含多列主键(城市/州/日期)和更多数据列的表。我希望得到每个城市/州的最新数据。如何干净/高效地完成这项工作?现在我可以通过执行第一个查询来获取我正在尝试获取的所有行的列表,然后使用大量WHERE子句进行第二次查询:
SELECT state, city, max(date) from data GROUP BY city, state;
+-------+---------------------+------------+
| state | city | MAX(date) |
+-------+---------------------+------------+
| CA | San Francisco | 2013-09-01 |
| CA | Los Angeles | 2013-08-01 |
| NY | New York | 2013-10-01 |
| ... | ... (many rows) ... | ... |
+-------+---------------------+------------+
SELECT * FROM data WHERE
(state = "CA" AND city = "San Francisco" AND date='2013-09-01') OR
(state = "CA" AND city = "Los Angeles" AND date='2013-08-01') OR
(state = "NY" AND city = "New York" AND date='2013-10-01') OR
...
This is really ugly and inefficient, and if the first query returns a lot of rows my second query might be too long. Clearly if I have a single-column primary key I could use a subselect with IN(), but that's not really possible here. Any suggestions?
这真的很丑陋且效率低下,如果第一个查询返回很多行,我的第二个查询可能会太长。显然,如果我有一个单列主键,我可以使用带有IN()的子选择,但这在这里是不可能的。有什么建议么?
UPDATE: I tried Bill's suggestion with a subselect, but it's not using any keys and is taking forever. If I restrict the subselect to only return 5 rows it returns in 0.64s. If I let it return all 73 city/state combinations, it takes a very long time (query still running).
更新:我用一个subselect尝试了Bill的建议,但它没有使用任何键,而是永远。如果我将subselect限制为仅返回5行,则返回0.64s。如果我让它返回所有73个城市/州组合,则需要很长时间(查询仍在运行)。
EXPLAIN SELECT * FROM data WHERE (city, state, date) IN (SELECT state, city, MAX(date) FROM data GROUP BY city, state)
+----+--------------------+-------+-------+---------------+---------+---------+------+-------+-------------+
| id | select_type | table | type | possible_keys | key | key_len | ref | rows | Extra |
+----+--------------------+-------+-------+---------------+---------+---------+------+-------+-------------+
| 1 | PRIMARY | data | ALL | NULL | NULL | NULL | NULL | 13342 | Using where |
| 2 | DEPENDENT SUBQUERY | data | index | NULL | PRIMARY | 57 | NULL | 8058 | Using index |
+----+--------------------+-------+-------+---------------+---------+---------+------+-------+-------------+
2 个解决方案
#1
4
I think this should do the trick for you:
我认为这应该适合你:
select
*
from
data t1
natural join
(
select
city,
state,
max(date) as date
from
data
group by
city,
state
) t2;
#2
4
MySQL supports tuple comparisons:
MySQL支持元组比较:
SELECT * FROM data WHERE
(state, city, date) IN (
('CA', 'San Francisco', '2013-09-01'),
('CA', 'Los Angeles', '2013-08-01'),
('NY', 'New York', '2013-10-01'));
#1
4
I think this should do the trick for you:
我认为这应该适合你:
select
*
from
data t1
natural join
(
select
city,
state,
max(date) as date
from
data
group by
city,
state
) t2;
#2
4
MySQL supports tuple comparisons:
MySQL支持元组比较:
SELECT * FROM data WHERE
(state, city, date) IN (
('CA', 'San Francisco', '2013-09-01'),
('CA', 'Los Angeles', '2013-08-01'),
('NY', 'New York', '2013-10-01'));