Go Back   Pro/Forums > ProCooling Technical Discussions > Testing and Benchmarking
Password
Register FAQ Members List Calendar JavaChat Mark Forums Read

Testing and Benchmarking Discuss, design, and debate ways to evaluate the performace of he goods out there.

Reply
Thread Tools
Unread 12-02-2005, 01:32 PM   #51
bigben2k
Responsible for 2%
of all the posts here.
 
bigben2k's Avatar
 
Join Date: May 2002
Location: Texas, U.S.A.
Posts: 8,302
Default Re: product testing today – who is being served ?

Quote:
Originally Posted by jaydee
I thought we were trying to put together a CPU based test bench all reviewers could afford and operate.
I don't think that we excluded a heat die just yet. In fact, I believe that a heat die is still preferable, but true CPU as a heat die would allow us to figure out what offset to apply to our results, to give out data that a user can relate to, i.e. :

I have an (AMD/Intel) proccy model XXX and I'm considering ABC cooling solution. Our testing results show that one would be able to get temperature X, but apply correction Y to figure out what one would actually read.

I'm not suggesting that we do both, but rather that we get together; one does real CPU, another a die sim. This requires that we measure temps the same way, so that we can relate. Grooved IHS measurement can be done by every tester.

Al, I'd be more than happy to assist anyone that has testing issues.
bigben2k is offline   Reply With Quote
Unread 12-02-2005, 01:43 PM   #52
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

no Ben, no heat die is any part of this discussion
no pH, ditto

you are not going to get anyone at all to make a convoluted heat die (even me probably)

if a TC is put on the IHS it will have to be read with a thermometer
anyone with a good price/performance suggestion (not off eBay) ?

refocus
if the goal is a CPU based testing system, then it could be considered in 2 parts:
1) grooved CPU and TC thermometer, CFxxx and DOW sensors for air (water optional) - suitable for sink or kit testing, components by substitution
2) as above plus flow and pressure measurement capability - to create parametric performance curves for components

lets focus on #1 only for now
BillA is offline   Reply With Quote
Unread 12-02-2005, 02:15 PM   #53
jaydee
Put up or Shut Up
 
jaydee's Avatar
 
Join Date: Dec 2001
Location: Spokane WA
Posts: 6,506
Default Re: product testing today – who is being served ?

Be noted the CF633 and sensors need serious calibration. In my experience the probes are far from consistent from each other. I got 8 probes with mine and only 3 would read somewhat close together. Others were off .5 to 5C. Also had one that would not scale liner to the others. For ever 10C on the others it would raise 9C for example. I found it to be a pain in the ass but it worked out ok after cherry picking the probes. Kinds sucks to have to buy a bunch of probes and hand pick though. Also the probes are far from water tight. They need good water proofing.

I still don't see people grooving their IHS's though.
jaydee is offline   Reply With Quote
Unread 12-02-2005, 02:36 PM   #54
Albigger
Cooling Savant
 
Join Date: Sep 2002
Location: ohio
Posts: 140
Default Re: product testing today – who is being served ?

Quote:
Originally Posted by bigben2k
...
I'm not suggesting that we do both, but rather that we get together; one does real CPU, another a die sim. This requires that we measure temps the same way, so that we can relate. Grooved IHS measurement can be done by every tester.
...
I'd like to see this also, but with both setups as professional as can be, so as to correlate/interpret the data. i.e. not what we're after in this thread.


Quote:
Originally Posted by jaydee
...
I still don't see people grooving their IHS's though.
Not in house, for sure. May be easier if we source a machinist or two, even better if we get mulitple reviewers to commit and send many procs to be done at the same time. I fear this may be unlikely, depends on cost though...

--Jay
Albigger is offline   Reply With Quote
Unread 12-02-2005, 02:41 PM   #55
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

re TCs
http://cgi.ebay.com/Fluke-2190A-Digi...QQcmdZViewItem
these things are not difficult to find
BillA is offline   Reply With Quote
Unread 12-02-2005, 02:50 PM   #56
Joe
The Pro/Life Support System
 
Joe's Avatar
 
Join Date: Dec 1999
Location: Denver, CO
Posts: 4,041
Default Re: product testing today – who is being served ?

Bill whats that wrong with the one I currently have (or if you think it will work for a test - it would seem that the resolution is similar to the fluke)

http://www.procooling.com/index.php?...icles&disp=100
__________________
Joe - I only take this hat off for one thing...

ProCooling archive curator and dusty skeleton.
Joe is offline   Reply With Quote
Unread 12-02-2005, 02:58 PM   #57
Joe
The Pro/Life Support System
 
Joe's Avatar
 
Join Date: Dec 1999
Location: Denver, CO
Posts: 4,041
Default Re: product testing today – who is being served ?

I was pondering last time when I was testing with TC's to pick up a calibrator such as : http://www.extech.com/instrument/pro...433201data.pdf

seems to be a "cheap" way to make sure your gear is still returning valid data.
__________________
Joe - I only take this hat off for one thing...

ProCooling archive curator and dusty skeleton.
Joe is offline   Reply With Quote
Unread 12-02-2005, 03:47 PM   #58
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

same resolution, the accuracy/uncertanty ~1/2 that of the Fluke (±0.5 vs. 0.3 or so, as I recall)
yes, a calibrator will work as a ck (eBay ?)
BillA is offline   Reply With Quote
Unread 12-06-2005, 05:39 AM   #59
Jag
Cooling Savant
 
Join Date: May 2004
Location: Portugal
Posts: 179
Default Re: product testing today – who is being served ?

Quote:
Originally Posted by BillA
no Ben, no heat die is any part of this discussion
no pH, ditto
...
refocus
if the goal is a CPU based testing system, then it could be considered in 2 parts:
1) grooved CPU and TC thermometer, CFxxx and DOW sensors for air (water optional) - suitable for sink or kit testing, components by substitution
2) as above plus flow and pressure measurement capability - to create parametric performance curves for components

lets focus on #1 only for now
Quote:
Originally Posted by Albigger
Not in house, for sure. May be easier if we source a machinist or two, even better if we get mulitple reviewers to commit and send many procs to be done at the same time. I fear this may be unlikely, depends on cost though...
Then could it be an option to provide custom made IHS, and already grooved, according to specs?
People would then cap off their AMD 64 cpu's, substitute their original IHS for these, and the fear of damaging the processor if one would attempt to groove the IHS would disappear.
Jag is offline   Reply With Quote
Unread 12-06-2005, 08:06 AM   #60
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

Quote:
Originally Posted by Jag
Then could it be an option to provide custom made IHS, and already grooved, according to specs?
People would then cap off their AMD 64 cpu's, substitute their original IHS for these, and the fear of damaging the processor if one would attempt to groove the IHS would disappear.
so a DIY TIM joint is automagically better than a factory one ?
in your dreams, going to take some data to convince me

my effort is to 'qualify' an existing CPU as a heat source,
not to make a heat die with an IHS as I do not think that such is within anyone's budget, talk this one to death

IF a CPU is to be selected for use as a heat source, why on earth pick a CPU with known TIM joint reliability issues ?

it seems the 'problem' with this idea is that using an Intel CPU is out of favor with the OCing community, though how Intel CPU heat differs from AMD heat is unclear

lets revisit die temps
what are the silicon temp 'limits' ? (not the 'case' (IHS) temp given in the thermal design gides eh)
I happen to know a number of these values, short term, long term, etc. but this info is not public
why the pursuit of die temps when the limits are unknown ?
BillA is offline   Reply With Quote
Unread 12-06-2005, 08:53 AM   #61
Joe
The Pro/Life Support System
 
Joe's Avatar
 
Join Date: Dec 1999
Location: Denver, CO
Posts: 4,041
Default Re: product testing today – who is being served ?

Bill, I must have missed it in the other thread, is there factual data on the TIM joint reliability issues with AMD? is there actual data behind that?

And is there any factual data bout Intels TIM joint reliability? From what I understood most of this is all assumptions still.

Just looking to get more smart on that topic.
__________________
Joe - I only take this hat off for one thing...

ProCooling archive curator and dusty skeleton.
Joe is offline   Reply With Quote
Unread 12-06-2005, 09:13 AM   #62
Les
Cooling Savant
 
Join Date: Oct 2001
Location: Wigan UK
Posts: 929
Default Re: product testing today – who is being served ?

Is the diode to be read known to be in the "hotspot"or is it still location unknown?
If the later; is the relation between it's temperature and IHS(Case) the relation which is sought
Think Incoherent's future Iron Age die may be more informative, it potentially being easier to model.
Les is offline   Reply With Quote
Unread 12-06-2005, 11:19 AM   #63
Marci
Cooling Savant
 
Marci's Avatar
 
Join Date: May 2003
Location: Wakefield, West Yorkshire, UK
Posts: 486
Default Re: product testing today – who is being served ?

Quote:
is there factual data on the TIM joint reliability issues with AMD? is there actual data behind that?
uncollated - factual as in a chunk of folks with first hand tales of the issue, inc myself altho I seem to be one of few who has had CPUs with duff IHS contact from new. No figures... just "know" of it happening and it's existence.

Never heard of issues with P4's...
Marci is offline   Reply With Quote
Unread 12-06-2005, 11:29 AM   #64
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

Joe,
Marci had some good anecdotal AMD 'problem descriptions', a phase change guy (Eric K) said the AMD thermal cycling problem was well known, plus my observations on the (non)removal of the Intel IHS with the absence of reported issues - different mfgn process

the assumption that the Intel internal TIM joint is stable seems quite valid

Les
2 courses here, CPU and die
I agree that the die is more suitable for modeling (w/o a long ton of assumptions re the CPU, mobo, etc)
a die will always yield more and better data as that is its purpose,
but as an alternative to the cost and complexity of a die I wish to explore using a real CPU in some fashion

something that we can recommend to those scorned and despised review sites

agreed there is a temp relationship between the IHS and the silicon (lol), but as you say where ? and what is it ?
seems simple, assume a TIM joint value and add a bit for IHS conduction and calc a die temp
BillA is offline   Reply With Quote
Unread 12-06-2005, 11:40 AM   #65
Les
Cooling Savant
 
Join Date: Oct 2001
Location: Wigan UK
Posts: 929
Default Re: product testing today – who is being served ?

Quote:
Originally Posted by BillA
(lol), but as you say where ? and what is it ?
seems simple, assume a TIM joint value and add a bit for IHS conduction and calc a die temp
If it is the "what" of interest, the power region,yes, should be simple.
But if not the high power then the so called compression is probably only known by the manufacturer. It will just add another temperature to the "unknown offset" list.
Les is offline   Reply With Quote
Unread 12-06-2005, 11:51 AM   #66
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

"But if not the high power then the so called compression is probably only known by the manufacturer"

not understood
BillA is offline   Reply With Quote
Unread 12-06-2005, 12:21 PM   #67
Les
Cooling Savant
 
Join Date: Oct 2001
Location: Wigan UK
Posts: 929
Default Re: product testing today – who is being served ?

Yes, can calc a die temperature but if not the temperature in "region of max power dissipation" then another offset is required. Our(pH's) temperature will only be the temperature that processor manufacturer allows us to see.
Still worth having - but I am not doing the work.
The difference in temperature of our(pH's) position of measurement and the temperature in the region of maximum power dissipation will be unknown to us.
I only guess that this is the temperature of "max power region"to which "well documented thermal characteristics of the TTV" applies (quote from memory).
Les is offline   Reply With Quote
Unread 12-07-2005, 12:14 AM   #68
PaulDriver
Cooling Neophyte
 
PaulDriver's Avatar
 
Join Date: Oct 2004
Location: Sin City
Posts: 37
Default Re: product testing today – who is being served ?

Why is it necessary to test with a CPU and not a calibrated heatsource as a simulated CPU?
__________________
Athlon 64 3000+ (Venice) @ 2.4Ghz (267x9) stock vcore on a ChainTech VNF4 Ultra (7-19 BIOS)
Kingmax 512MB DDR 466 x2 @ 480MHZ 7-3-3-2.5-1T, GeForce 6600 PCI-Express
1 160GB, 1 80GB, 4 200GB (on SATA) and 1 DVD Dual writer
All housed in a circa 1997 inwin case hacked into the flipped BTX style
Air cooled, First time since 2001. It's not noisy, what's wrong?
PaulDriver is offline   Reply With Quote
Unread 12-07-2005, 12:21 AM   #69
Albigger
Cooling Savant
 
Join Date: Sep 2002
Location: ohio
Posts: 140
Default Re: product testing today – who is being served ?

Quote:
Originally Posted by PaulDriver
Why is it necessary to test with a CPU and not a calibrated heatsource as a simulated CPU?

I think because that would cost money and Bill was trying to see what could be done by 'typical' review sites without laying out too much cash (which they would be unlikely to do).
Albigger is offline   Reply With Quote
Unread 12-07-2005, 01:08 AM   #70
PaulDriver
Cooling Neophyte
 
PaulDriver's Avatar
 
Join Date: Oct 2004
Location: Sin City
Posts: 37
Default Re: product testing today – who is being served ?

So what is the projected budget?
__________________
Athlon 64 3000+ (Venice) @ 2.4Ghz (267x9) stock vcore on a ChainTech VNF4 Ultra (7-19 BIOS)
Kingmax 512MB DDR 466 x2 @ 480MHZ 7-3-3-2.5-1T, GeForce 6600 PCI-Express
1 160GB, 1 80GB, 4 200GB (on SATA) and 1 DVD Dual writer
All housed in a circa 1997 inwin case hacked into the flipped BTX style
Air cooled, First time since 2001. It's not noisy, what's wrong?
PaulDriver is offline   Reply With Quote
Unread 12-07-2005, 05:04 AM   #71
Marci
Cooling Savant
 
Marci's Avatar
 
Join Date: May 2003
Location: Wakefield, West Yorkshire, UK
Posts: 486
Default Re: product testing today – who is being served ?

undecided / unfixed. Budget will be whatever it costs once parts are decided. No matter how it's done, real CPU testing should still work out cheaper to produce than diesim etc... in theory...

and just for clarity to other readers...

Quote:
Anecdotal evidence is unreliable evidence based on personal observations and experiences (often recounted by way of anecdote) that has not been empirically tested, and which is often used in an argument as if it had been scientifically or statistically proven. The person using anecdotal evidence may or may not be aware of the fact that, by doing so, they are generalizing.
In my case, aware of generalisation and lack of empiricism when statement made...
Marci is offline   Reply With Quote
Unread 12-08-2005, 12:28 PM   #72
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

as the use of a CPU with an IHS to test cooling solutions has been roundly denounced as unacceptable in the Apogee thread; it is time to close this topic, at least for procooling

it seems that while there is considerable interest in rather exotic testing hardware, this does not extend to consideration of a test method utilizing a CPU with an IHS (as bought)
by declining the challenge of defining a CPU based testing system, used for 99% (?) of all 'reviews', procooling forfeits the opportunity to shape, and assist those doing, that type of testing

is procooling only to address the absolute high-end ? (as seen from within procooling)
BillA is offline   Reply With Quote
Unread 12-08-2005, 12:53 PM   #73
Joe
The Pro/Life Support System
 
Joe's Avatar
 
Join Date: Dec 1999
Location: Denver, CO
Posts: 4,041
Default Re: product testing today – who is being served ?

Bill... the more I look at it the more it makes no sense to test with more unknown variables than are needed to do a simple, inexpensive (relatively) test. Since you cant prove that the Intel TTV's or CPU's are 100% consistent, since no one can prove for fact what kind of inconsistencies are seen with AMD cpu over a range of CPU's and different plants (same goes for Intel)...

I think in large the IHS is a liability to the testing no matter who makes the chip. Since we are discussing testing something that there are few facts about (just lots of assumptions and word of mouth observations from friends of friends of friends), and little confidence in getting real tangible results from on a consistent basis... It just seems to go against the logic that got us to the point of testing the way we are.

I mean look at the review industry as a whole, its all moving to better ways and methods. Think 5 years ago when most sites used mobo probes and MBM to do review testing with. Someones gotta move testing forward... or present different ideas and ways of doing it. Being happy with the variability in an IHS as "real world" gets us back to MBM days.

I don't buy that testing without an IHS is an absolute high end, to me if you are an enthusiast, you probably are going to remove an IHS to get your moneys worth out of the cooling system. I just see us as catering to our audience: enthusiasts.

If procooling stands on its own to test in a way that is logically more sound than other sites, I guess thats what happens. We've been there before. If other sites want to join in and start testing sans IHS, then so be it.
__________________
Joe - I only take this hat off for one thing...

ProCooling archive curator and dusty skeleton.

Last edited by Joe; 12-08-2005 at 01:13 PM.
Joe is offline   Reply With Quote
Unread 12-08-2005, 01:32 PM   #74
BillA
CoolingWorks Tech Guy
Formerly "Unregistered"
 
Join Date: Dec 2000
Location: Posts: 2,371.493,106
Posts: 4,440
Default Re: product testing today – who is being served ?

I've no real objection Joe, I just think we are walking away from something that is potentially useful - even with limitations
no mechanic discards a tool
BillA is offline   Reply With Quote
Unread 12-08-2005, 01:36 PM   #75
TerraMex
Cooling Savant
 
TerraMex's Avatar
 
Join Date: Nov 2002
Location: Portugal, Europe
Posts: 870
Default Re: product testing today – who is being served ?

Quote:
no mechanic discards a tool
... but his main tool is still a hammer .
__________________
"we need more cowbell."
TerraMex is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -5. The time now is 05:26 PM.


Powered by vBulletin® Version 3.7.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
(C) 2005 ProCooling.com
If we in some way offend you, insult you or your people, screw your mom, beat up your dad, or poop on your porch... we're sorry... we were probably really drunk...
Oh and dont steal our content bitches! Don't give us a reason to pee in your open car window this summer...