Australian Company Promises Switching Hardware With Sub-130ns Latency 77
snowdon writes "The race for low-latency in finance and HPC has taken a major turn. A bunch of engineers from Australia have 'thrown away the air conditioning' in a traditional switch, to get a 10G fibre-to-fibre latency of less than 130ns! Way faster than more traditional offerings. This lady (video) would tell you that it's equivalent to just 26m of optical fibre. Does that mean we just lose money faster?"
Low latency post (Score:5, Funny)
The trick was not reading TFA.
Lower latency post (Score:2)
The trick was not reading TFS.
Re: (Score:3)
Remember what happened last time someone copied an Australian invention without paying the licensing fee! We own low-latency now.
Goldman Sachs will be pleased (Score:3)
Re: (Score:1)
Now they can suck our economy dry with even more speed and efficiency!
I'm sure they'll have some nice propaganda to tell us all about how this benefits the common man.
Enriching ourselves without producing anything of value is good for you, really! Now grab your ankles and prostrate yourselves before the financial machine again...there there... that's a good subject I mean citizen. Man financial slavery is much easier than the old way, why intimidate when you can brainwash? Now bust your ass at your low wage job to create more value for us, and be thankful you even have
Re: (Score:2)
Now they can suck our economy dry with even more speed and efficiency!
I'm sure they'll have some nice propaganda to tell us all about how this benefits the common man.
They already do; it's called the 2012 Presidential Election. [opensecrets.org]
Donations to Barack Obama in 2008 - $1,013,091
2012 (reported thus far) - $80,224
Donations to Mitt Romney (2012, reported thus far) - $528,180
I believe this is what they in the finance 'industry' refer to as "hedging."
130ns? (Score:1)
Pfft, I can't win Quake matches with that latency.
Can't access "the lady" on youtube (Score:1)
Darn work and filtering. ;-) Oh well..... I'll bookmark and watch it when I get home 11 hours from now.
Versus InfiniBand? (Score:2)
Can these numbers be directly compared to the "fiber-to-fiber latency" reported in the article summary?
Re: (Score:2)
Good luck getting more than 8 inches/ns with real world cables and real world fiber. You can get darn near 11 inches/ns with ladder line and open wire and exotic RF stuff like that (yes it is easily possible to buy faster copper than fiber, if by faster you mean lower latency). Wake me when they switch to ladder line instead of fiber, that'll be the weird day.
The term to google for is velocity of propagation.
Re: (Score:2)
Re: (Score:2)
The shortest wavelength I've seen used with ladder (twin lead) line is lower UHF (think TV antenna.) The velocity of ladder line is mostly used to determine tuning of an antenna, mostly in the HF realm. Coax also has velocity ratings, as does any electrical path.
I'm not sure of using ladder line for high speed data except for your DSL drop to your house from the pole. That is a type of ladder line. I guess you could call twisted pair a special case of ladder line.
Re: (Score:2)
Wake me when they switch to ladder line instead of fiber, that'll be the weird day.
My DSL is delivered via ladder line, at least the last few feet from the pole to the house.
http://www.manufacturer.com/cimages/product/www.alibaba.com/0320/a/50038610_50184028_Telephone_Cables_Telephone_Drop_Wire.jpg [manufacturer.com]
HFT Should be illegal (Score:4, Insightful)
This is not good news; it promotes a trend in a technological approach to making money in the stock market that should be flat out illegal.
Re:HFT Should be illegal (Score:5, Insightful)
This is not good news; it promotes a trend in a technological approach to making money in the stock market that should be flat out illegal.
Why? I know what it is, how it works, how it makes money, and I'm not overly concerned. So they make a market, and they make it really fast. Eh.
All I ever hear as a rationalization for dislike of it is "workers of the world unite" and "1% OWS" and "something bad happened to the markets, I don't like witches, so lets hang the witch because she has property I like that we can take from her" and "I hate the rich" and all that sort of stuff. I never hear a good moral or ethical explanation of why doing what you normally do, but really fast, is so wrong.
Another good question, is assuming you "make it illegal" how in the world would you enforce that? What would the reg look like? Like... your connection to the market must be this far away blah blah even if it means making a 1000 KM coil of fiber on the data center floor, or maybe all traders must connect to "the market" over geosync satellite links so the average latency is both long and more or less equal?
Please don't confuse conventional HFT with "Flash trading" which is basically window dressed up insider trading, corrupt as all heck. If you do insider trading and trade your own book etc thats just illegal, but if you do it really fast people like to pretend its just "flash trading" and not wrong.
The easiest way to "get rid of" HFT is to fix decimalization. Back when we traded on eights thats too wide to make money on a HFT strategy, and if we allowed millionth of a penny trading quotes that would narrow bid/ask resulting in too little money generated by HFT. Decimalization seems to be almost the perfect pricing system to result in massive HFT strategies, so if you really hate HFT (and WHY?) then just fix the pricing structure so its not profitable anymore. Rather than playing games with legal enforcement of favored or disfavored behavior, simply make disfavored behavior unprofitable. I suppose the opposite solution of going big would work just as well, fine we'll only trade stocks on dollar values now no fractions of a dollar.
Re: (Score:3)
I never hear a good moral or ethical explanation of why doing what you normally do, but really fast, is so wrong.
The nuns back in grade school gave us moral reasons not to wash "down there" really fast. Although through much "scientific discovery" I concluded they were wrong (or just trying to keep a good thing for themselves.)
Re: (Score:3)
The problem with HFT is the "fake" orders placed. Computer trades typically will places tons and tons of buy AND sell orders for prices they really have no intention of executing on just so they can be first in the queue.
Yeah, but why is that a problem? IF they get executed on they lose their shirt, if not who cares? Using "problem" as in ethical or moral dilemma that we should legislate out of existence, not "problem" as in "I don't personally like it, just like I don't like strawberry icecream, so men with guns should forcibly stop people from doing what I don't like". I need something more than its bad, because by definition its bad. A real world example with numbers.
AC you and I both think one internets (or karma po
Re: (Score:2)
the stock market was meant to provide a way for people to invest in businesses.
that's how it's wrong. there's no investing here.
So, the best way to invest in businesses is to make the spread between bid and ask prices as large as possible, and lower liquidity as much as possible. Hmm. Not really agreeing the goal meets the methods.
What is investing? Determining a value for a security, comparing it to the current price, and entering the appropriate market order. What is HFT? Same thing. Faster than traditional 1960s era trading, sure, but nothing different. That makes regulating it very hard.
Its kind of like arguing that free
Re: (Score:2)
Nonsense. You could rip out 100% of the HFT hardware right now, and guess what? Bid and ask would still come together and result in a trade just as they have always done. The only difference is that the cover charge keeping the 'riff raff' out will be greatly lowered.
To make it a genuinely fair market, set the time quantum at 10 minutes. No more HFT, no more rent.
Re: (Score:2)
The problems I have with HFT are:
1) At least at one point of time it was (is?) a front running scam - favoured HFT traders got to front-run others ( http://www.nytimes.com/2009/07/24/business/24trading.html [nytimes.com] )
2) When favoured HFT players screw up, the exchange rolls back their trades: http://money.cnn.com/2010/05/07/markets/explaining_wall_street_turmoil/ [cnn.com]
Even an idiot like me can make lots of money if the exchange keeps rolling back my biggest mistakes.
Call me cynical but all that HFT, fancy math and fancy s
Re: (Score:2)
You do realize that slavish adherence to those formulas is what created a systemic weakness resulting in the economic meltdown. The advantage of Grandpa's gut is that it introduces enough variability in the valuation to avoid those divide by zero moments.
It's funny how you speak of valuation as if it were some sort of objective truth based on universal constants or something.
Trading has increasingly abstracted away any sense of a good to be traded. As it does so, it more closely approaches casino gambling.
Re: (Score:2)
Beyond the rent seeking, a market flooded by insincere offers is no market at all.
If the HFT is so unprofitable and dismal like you claim, why are so many very rich financial institutions so willing to spend megabux just to get the network cables to their servers 3 feet shorter than the other guy's?
Re: (Score:3)
The problem with HFT is that it undermines the whole point of central markets and business investment into human endeavour
Please advise me as to the purpose of "central markets" and "business investment" and then explain why increasing the bid ask spread and decreasing liquidity by the destruction of HFTs somehow helps achieve those goals. Or alternately, why lowering the bid ask spread and increasing liquidity somehow magically prevents the achievement of those goals. I strongly suspect you can't.
The problem with a tax is, from the retail non-HFT perspective, a HFT looks to them like a microscopic tiny transaction tax in th
Re: (Score:2)
As I've said before, bid and ask will continue to come together to result in a trade as they have for all time. The only people who actually NEED the sort of liquidity you're talking about are the speculators (casino gamblers). Investors think in terms of months to decades and trades happen plenty fast for them without HFT skimming off the top..
HFTs increase the sales price by a buck by improved liquidity and narrower bid/ask
[citation needed]. Furthermore, that would kinda suck if I want to buy 100 shares, then you jacked the cost up a dollar and ripped me off for a penny to boot!
Re: (Score:2)
The easiest way to "get rid of" HFT is to fix decimalization. Back when we traded on eights thats too wide to make money on a HFT strategy, and if we allowed millionth of a penny trading quotes that would narrow bid/ask resulting in too little money generated by HFT. Decimalization seems to be almost the perfect pricing system to result in massive HFT strategies, so if you really hate HFT (and WHY?) then just fix the pricing structure so its not profitable anymore. Rather than playing games with legal enforcement of favored or disfavored behavior, simply make disfavored behavior unprofitable. I suppose the opposite solution of going big would work just as well, fine we'll only trade stocks on dollar values now no fractions of a dollar.
Don't forget that it was possible to game they system in different ways when they traded on fractions. Changing the decimal system seems a bit overkill(also, I'm still a bit confused how that wouldn't create further issues?) when a small tax on ultrafast trades/a small delay on the stock exchange end would solve the problem created by these HFT machines.
Re: (Score:2)
also, I'm still a bit confused how that wouldn't create further issues?
The HFT idea is to "win" maybe 1% of time on a 50% of the bid ask spread times number of shares traded by retail non HFT investors.
Assume the non-HFT quantity remains the same.
Using penny level decimalization, the bid ask difference will tend toward... a penny. So 1% of 50% of a penny times a billion shares traded per day is $50K per day, optimistically (assuming you "win" as much as 1% of the time, probably much less). Times 200 stocks, that's $10M revenue per day well worth building the infrastructure t
Re: (Score:2)
Re: (Score:2)
A penny per share tax is a buck on a round lot trade of 100 shares to kill HFTs. The problem is I don't lose a buck to HFTs but I would lose a buck to the govt. Its just a cheesy stealth taxation plan. Blame the HFTs, rich people suck, horray for the 99% we're gonna destroy HFTs, but the only real end result is the govt takes more of my money. So a transaction tax is a great way to cause a couple orders of magnitude more damage to the economy than HFTs could theoretically ever cause.
This still doesn't e
Re: (Score:2)
A penny per share tax is a buck on a round lot trade of 100 shares to kill HFTs. The problem is I don't lose a buck to HFTs but I would lose a buck to the govt. Its just a cheesy stealth taxation plan. Blame the HFTs, rich people suck, horray for the 99% we're gonna destroy HFTs, but the only real end result is the govt takes more of my money. So a transaction tax is a great way to cause a couple orders of magnitude more damage to the economy than HFTs could theoretically ever cause.
Who's to say this money would go to the government? Don't exchanges need to pay huge amounts of money for infrastructure to support this activity? Also, isn't there a clear segregation between "normal" traffic and this high speed traffic?
This still doesn't explain the fixation on killing HFTs. So they get a "sin" tax. On what sin, exactly? nobody knows.
Because financial engineering has just been so beneficial to society... /s
http://en.wikipedia.org/wiki/High-frequency_trading#Effects [wikipedia.org]
http://en.wikipedia.org/wiki/2010_Flash_Crash [wikipedia.org]
WRT increasing transaction volume to make more than $1000... Remember that superman movie where Richard Pryor took all the fractional cents out of everyone paycheck, put them in a pile, and kept that substantial amount? Well HFT is like that in trades where a bunch of competing HFTs fight each other to, on long term average, determine the sub-cent price of a share priced in cents, and then, essentially, the HFT who skims off the least amount on top of the sub cent slice beats the greedier HFTs and keeps the extra skim. Well, in the movie, if Richard Pryor wanted more money, he'd have to make more transactions, make more paychecks. But Mr Pryor doesn't get to decide how many times paychecks are written per month (Weekly checks? Daily checks?), or how many people are employed... This tired old hollywood plot was recycled into Office Space, and probably many more movies. There's only like 50 movies, endlessly redone.
Ya ya ya, we all know the old skimming scheme that's become possible because of electronics controlling money. Just because there is a way to manipulate a system, doesn't make it a good thing. 21 is a good (blackjack)movie, but will still get you thrown out of a casino. There's nothing to say that these HFT's aren't skimming money from regular investors and vice-versa. That said though, why does the market exist in the first place? It's not for a bunch of machines to race to the penny.
Think about making a competitive system to determine the sub cent fractional price of shares traded at cent rounded prices. Read the wikipedia article below. You pretty much end up reinventing HFT.
http://en.wikipedia.org/wiki/Simulated_annealing [wikipedia.org]
Instead of sending me to a generic NP-Hard problem, I find this - http://en.wikipedia.org/wik [wikipedia.org]
Re: (Score:2)
There are several reasons as to why HFT should be illegal. And it doesn't have anything to do with your stupid strawman arguments regards OWS etc, or front running which has been illegal for some time.
Some examples of the abuse that occurs are the practices of placing and rapidly cancelling limit orders to stimulate market orders on the other side, which are then executed at a less favorable price also placed by the HFT. In other words, HFTs are gaming the system to exploit sub-optimal behavior by slower tr
Re: (Score:2)
Another good question, is assuming you "make it illegal" how in the world would you enforce that? What would the reg look like?
That's really easy: Nobody (and I mean nobody) gets access to flash orders. No stock exchange should be allowed to let a third party inspect the details of a pending trade, and then make their own transaction before the initial trade is complete.
That is so painfully obvious I can't believe you would have to ask.
Re: (Score:3)
This is not good news; it promotes a trend in a technological approach to making money in the stock market that should be flat out illegal.
I always thought that if those losers in Anonymous (or anyone else sick of Wall St. and their economic stranglehold) wanted to actually do something meaningful, they would create and release an open source HFT program anyone can use, and help the populace beat the banksters at their own game...
nudge nudge...
Re: (Score:1)
Re: (Score:2)
The bankster's game has nothing to do with HFT. Regardless, you aren't going to beat HFTs with software, you also need physical proximity to the exchange's gateways. And that isn't cheap.
Well, if that's the case then I agree with OP's assessment that the process should be criminalized.
Re: (Score:1)
Re: (Score:2)
Re: (Score:2)
The banks choose cto locate their trading computer systems right next to (if not in) the co-location centers where the fibre-optic routers of the trading network are connected. The boxes being discussed connect those computers to the trading network. Everyone else gets the slow as molasses "Internet".
The trading algorithms work by making frequent future price bids and sales, then cancelling those if the price isn't right. Then they can pocket the difference. Because of their proximity and short "hop" distan
Re: (Score:2)
Re: (Score:2)
there's plenty of robo trading programs available for you if you wish..
the problem is that you'd need to get preferential fast access to the market too for them to be any good for you.
now - add the fact that it's the same entities providing the chance to trade these stocks which has that preferential treatment(bought with money, sure) and it does get a little fishy. they're running a business using information which at the point that they receive it is in fact insider information(obtained before others have
Re: (Score:2)
Re: (Score:2)
Even if they did create a HFT program that everyone could use, and even if it didn't require colocation in the exchange's server room thanks to the speed of light (which it does), and even if it did manage to outsmart the existing trader's software, the big traders would just find some way to have them arrested and convicted of fraud just like they did with the last group who tried that without inside contacts and political influence. You see, apparently it's fraud to do HFT in a way that confuses someone e
Would have helped FB IPO (Score:2)
It would have helped in the Facebook IPO. All the investors with this level of link would have devalued Facebook stock faster than normal folks on DSL could have bought it.
http://www.google.com/finance?client=ob&q=NASDAQ:FB
Expand out the whole chart. Looks like a great design for a water slide at a kiddie park.
Re: (Score:2)
Now drains your purse faster.... (Score:2)
Where you could previously only bailout one ot two banks per year, thanks to this technology about a dozen bailouts are now possible.... Isn't it nice.
Low latency in financial market trades (Score:2)
Is like playing the Russian roulette game. With plutonium bullets. Close to a fuel tank.
Yes, we'll all loose money much faster!
Re: (Score:2)
"can back-order at the price of the stock when the order was given."
interesting, but if someone else already got that stock at that price, by what right can they give you someone else's stock at a price different than they were offering? where's that price difference getting made up?
Re: (Score:2)
The short-term trading reduces the average profitability of long-term trades. It is like purchasing goods direct from the manufacturer, versus purchasing goods via a variety of middle-men. The middle-men must extract a markup to pay for their time.
The big stock market traders have found a new variation on the centuries old system of middle-men. They speculatively execute trades designed to intercept profitable movements on the stock market. In short, they purchase from the seller before the long-term t
Re: (Score:1)
Meanwhile... (Score:5, Interesting)
Even if a lot of research has been put into reducing the latencies of switching technology, the vast majority of real-world deployments are nowhere near where they should be. The result is corporations spending millions upgrading their core switching, and then the result is the same or worse than what they had with ordinary gigabit technology.
I've been to more than half a dozen sites recently with new installations of 10 GbE, but with terrible network performance. All too often, I'm seeing latencies as high as 1.3 milliseconds even for servers on the same switch. Read up on bandwidth-delay product [wikipedia.org] too get an idea of why this would severely nerf throughput. The odd thing is that at a number of these sites, older servers with 1 GbE connected to the same switching infrastructure get 100% of wire speed without issues.
I don't know exactly what the root cause is, but I'm starting to suspect that the extra latency is coming from somewhere that network engineers don't usually test, like CPU power management taking an excessively long time to wake up a core to respond to a packet. What I think happens is something like this:
- The fast network delivers a burst of data very quickly.
- The receiver CPU starts to slowly wake up from sleep mode, while the sender is waiting for an ACK packet, because it has finished sending an entire TCP window.
- The sender CPU goes to sleep, because it still has nothing to do.
- The receiver CPU finally gets around to the packet, which it processes quickly and efficiently, sending the ACK back.
- The receiver OS sees that the CPU is "0.1%" busy, has nothing to do now, so it sends it to back to sleep.
- The sender CPU starts to slowly wake up, while the receiver is also asleep, waiting patiently for more data.
- The cycle repeats, with more waiting at every step.
With slightly slower networks or CPUs, the CPUs never get a chance to be idle long enough to enter a sleep state, so everything is always ready for more data. I've seen 3x improvements in iPerf TCP throughput by simply running a busy-loop in a background process!
Re:Meanwhile... (Score:4, Interesting)
The number of interrupts per second that a modern processor can handle has stayed relatively fixed for a large number of years, and network response time is a strong function of interrupt performance.
It has been a while since I benchmarked interrupt response on a variety of processors with the same block of code. However, when I last did it, a 32 MHz 8-bit PIC18 series microcontroller (MCU) was capable of processing a real-time interrupt at 10,000 times per second. A much faster 3 GHz x86 CPU could manage 70,000 interrupts per second under Real-Time Linux. This wasn't much of an improvement, considering the x86 CPU is theoretically 100 times faster, was capable of executing multiple instructions per clock, and the little 8-bit PIC MCU has a hard limit of around 8 MIPs.
Why does this happen?
For a variety of factors including:
1. The amount of data a modern CPU must flush on an interrupt is huge. Most of the cache needs to be flushed and replaced, and this means a great deal of memory bus bandwidth.
2. Main memory latency in the modern PC is huge. Modern compiler designers assume it to be on the order of 100's of clocks.
3. Modern operating systems have to reload the page tables for every user/kernel mode transition. This takes time, and possibly more interrupts.
4. The I/O response time of the PCI bus is terrible relative to the cycle time of the processor. This means that most of the network traffic is transferred via DMA. However, this optimization only helps in terms of bandwidth, not latency.
5. Multiple cores don't really help. Synchronization overhead is a killer. Tricks like software transactional memory can help, however typical I/O devices lack the ability to support software transactional memory. Even simple techniques, like giving each core its own I/O and thus eliminating synchronization overhead, are often not implemented. Linux is still trying to eliminate the "Big Kernel Lock".
In short, the interrupt response latency in modern processors has really not improved much. This was a big discussion in some of the Ethernet working groups, because some of the simulations pointed out that 10Gb Ethernet performance might be limited by interrupt response time on the processors.
Re: (Score:3)
Should make for some fast routers. It is being ported to Linux and
Re: (Score:3)
- FWIW, Linux finally got rid of the BKL in the 3.0 release or thereabouts.
- Many (most?) 10Gb NIC's are multiqueue, meaning that the interrupt and packet processing load can be spread over multiple cores.
- Linux and presumably other OS'es have mechanisms to switch to polling mode when processing large numbers of incoming network packets.
That being said, your basic points about interrupt latency being an issue still stand, of course.
Re:Meanwhile... (Score:4, Interesting)
That's similar to what I'm seeing.
I found a "DPC ping" tool which queues a simple Kernel task from User mode, and measures the response time as if it was an actual network ping.
I found it interesting that it was well correlated with both ping times and tested network throughput, and that the DPC ping time wasn't consistent. Some fast CPUs had terrible DPC pings, and some older slower models were much faster. The operating system also contributes significantly, I found some combinations where the average was OK, but there were regular spikes of high latency.
Now that I've done more benchmarks across more sites, I've been recommending jumbo frames much more often. Previously I though it was a nice-to-have, but these days I'm starting to be of the opinion that without it the money spent on "10 GbE to the server" is just wasted.
Re: (Score:1)
Side Effect (Score:2)
Unfortunately, their hardware has the unfortunate side-effect of flipping all bits upside-down.
Re:Side Effect - Doubles the profit (Score:2)
Unfortunately, their hardware has the unfortunate side-effect of flipping all bits upside-down.
This is actually to the benefit of their sales department because you always have to buy them in pairs. :D
Cable lengths (Score:2)
Anyone with a mind set in reality will understand how didiculous that is!