当前在线人数16642
首页 - 分类讨论区 - 电脑网络 - 数据库版 -阅读文章
未名交友
[更多]
[更多]
文章阅读:Re: question on large tables (>=800 million records, 10 G
[同主题阅读] [版面: 数据库] [作者:wyr] , 2007年01月20日01:33:16
wyr
进入未名形象秀
我的博客
[上篇] [下篇] [同主题上篇] [同主题下篇]

发信人: wyr (遗忘小资), 信区: Database
标  题: Re: question on large tables (>=800 million records, 10 G b
发信站: BBS 未名空间站 (Sat Jan 20 01:41:41 2007), 转信

I do not quite catch what you guys are discussing here,
you are just saying that you have a 800M record table with no active insert/
update/delete and you want to query it by PK?
800M line does not sound like a extremely huge one consider your data file
is
only 10G.
If you just want to find result, then you may build a customized B-Tree to
store your PK . You can easily implement parition or hash here to help
compress the tree, right? With this implementation, you can shrink the
physicalsize of your index file(s)
And with this index, I believe you can easily point each entry of your Pk to
a particular location in a file(s). With the help of customized hash or
parition, yyour search on partitioned index files can't be too long.

Finally, hardwares are so so cheap today, why not simply get a large disk
array and use RAID to improve your IO performance, your RAM is simply too
small for the problem you described here...

【 在 babycry (babycry) 的大作中提到: 】
: Thanks! I like this suggestion.
: This is actually the approach we are currently using.
: It is pretty ad hoc, however, it saves a lot of software-engineering time.
: We dislike software-engineering since we are not accredited for doing it.
: The current query time is normally 2~5 minutes.
: This query time is not good for webapps,
: but is acceptable for data mining.
: Since we do not update/insert,
: the data integrity issue of having several copies of the same data
: is not a problem. 
: ...................


--

※ 修改:·wyr 于 Jan 20 01:43:20 修改本文·[FROM: 70.244.]
※ 来源:·BBS 未名空间站 mitbbs.com·[FROM: 70.244.]

[上篇] [下篇] [同主题上篇] [同主题下篇]
[转寄] [转贴] [回信给作者] [修改文章] [删除文章] [同主题阅读] [从此处展开] [返回版面] [快速返回] [收藏] [举报]
 
回复文章
标题:
内 容:

未名交友
将您的链接放在这儿

友情链接


 

Site Map - Contact Us - Terms and Conditions - Privacy Policy

版权所有,未名空间(mitbbs.com),since 1996