当前在线人数12069
首页 - 分类讨论区 - 电脑网络 - 数据库版 -阅读文章
未名交友
[更多]
[更多]
文章阅读:Re: question on large tables (>=800 million records, 10 G
[同主题阅读] [版面: 数据库] [作者:Assailant] , 2007年01月18日20:33:23
Assailant
进入未名形象秀
我的博客
[上篇] [下篇] [同主题上篇] [同主题下篇]

发信人: Assailant (反恐精英 勇救人质 拆弹专家), 信区: Database
标  题: Re: question on large tables (>=800 million records, 10 G bytes
发信站: BBS 未名空间站 (Thu Jan 18 20:33:23 2007)

how is the data collected, or updated/inserted? do you get a data feed at
certain time of the day, or is this going to be a static set of data you are
working with?

have you considered breaking the data into smaller groups of files, and load
only the needed data into a temp table when requested.

cabID_0000.txt
cabID_0001.txt
....

each of those files would contain all the data associated with that cabID.
and when a request comes in, read the file(s) and write them to a table for
query

you can do the same for timestamp, and location data. break them into small
ranges maybe.
200601.txt
200602.txt etc

latitude00000to00999.txt
latitude01000to01999.txt etc

longitude00000to00999.txt
longitude01000to01999.txt etc

data files overlap on information so the size of the total data grows 4
times, but it gives you the logical break down on what to load into DB for
query and reporting.


and upgrading your hardware will improve the preformance alot
--

※ 来源:·BBS 未名空间站 http://mitbbs.com·[FROM: 172.25.]

[上篇] [下篇] [同主题上篇] [同主题下篇]
[转寄] [转贴] [回信给作者] [修改文章] [删除文章] [同主题阅读] [从此处展开] [返回版面] [快速返回] [收藏] [举报]
 
回复文章
标题:
内 容:

未名交友
将您的链接放在这儿

友情链接


 

Site Map - Contact Us - Terms and Conditions - Privacy Policy

版权所有,未名空间(mitbbs.com),since 1996