Initially open-sourced in 2012 and followed by its first stable release two years later, Apache Spark quickly became a prominent player in the big data space. Since then, its adoption by big data companies has been on the rise at an eye-catching rate.In-memory processingUndoubtedly a key feature of Spark, in-memory processing, is what makes the technology deliver the speed that dwarfs performance of conventional big data processing. But in-memory processing isn’t a new computing concept, and there is a long list of database and data-processing products with an underlying design of in-memory processing. Redis and VoltDB are a couple of examples. Another example is Apache Ignite, which is also equipped with in-memory processing capability supplemented by a WAL (write-ahead log) to address performance of big data queries and ACID (atomicity, consistency, isolation, durability) transactions.Evidently, the functionality of in-memory processing alone isn’t quite sufficient to … [Read more...] about The rise and predominance of Apache Spark
You’re not a data scientist. Supposedly according to the tech and business press, machine learning will stop global warming, except that’s apparently fake news created by China. Maybe machine learning can find fake news (a classification problem)? In fact, maybe it can.But what can machine learning do for you? And how will you find out? There’s a good place to start close to home, if you’re already using Apache Spark for batch and stream processing. Along with Spark SQL and Spark Streaming, which you’re probably already using, Spark provides MLLib, which is, among other things, a library of machine learning and statistical algorithms in API form.[ Roundup: TensorFlow, Spark MLlib, Scikit-learn, MXNet, Microsoft Cognitive Toolkit, and Caffe machine learning and deep learning frameworks. | Cut to the key news and issues in cutting-edge enterprise technology with the InfoWorld Daily newsletter. ]Here is a brief guide to four of the most essential MLlib APIs, … [Read more...] about Which Spark machine learning API should you use?
What with the holidays coming up faster than a reindeer being chased by a menorah, we've got a couple fun little robot gifts that are so cheap you might as well just buy them for yourself. iRobot is releasing a new iOS app, and let me just say that no, it's not a way for you to remotely interact with your Roomba (sad). Instead, it's a game where you drive a Roomba around picking up dirt, avoiding evil dust bunnies, and tolerating the molestations of curious cats and overly affectionate humans: Does this game hint that the next generation of Roombas will actually come with giant pointy teeth and be able to devour small animals as well as vacuum your floors? Our professional opinion: maybe. It's definitely a fun little game (we tried it out ourselves), but the real reason we're writing about it is that iRobot has pledged to give a portion of the proceeds from Roomba Revenge to SPARK, their robot-focused STEM (science technology engineering math) educational program. Fun game, cheap … [Read more...] about Fun Robot Stuff: Roomba Revenge and My Robot Nation
ETH Zurich's Flying Machine Arena has spawned all kinds of mind blowing quadrotor tricks over the years, so it's not at all surprising that it's also spawned a spin-off performance company to take some of those tricks out into the world for the rest of us to enjoy. Verity Studios is combining ETH Zurich's experience with precision flying robots with the wild imaginations of creatives like Cirque du Soleil, starting with a short film called "Sparked" featuring a swarm of quadrotors with lampshades on their heads. While filming probably required many, many takes as well as a controlled environment with a motion-tracking system to precisely fly the quadrotors, none of what you're seeing here is CGI: it's all real robots, doing real things, in real time, with a real human in the middle of it. Some of what you're hearing here has certainly be modified, though: 10 quadrotors in close proximity sounds like a swarm of giant robot bees. That are angry. With you. Here's some … [Read more...] about Flying LampshadeBots Come Alive in Cirque du Soleil Performance
The webinar will show the general approach to simulate multipaction and breakdown analysis with CST STUDIO SUITE®. Since multipaction is an effect dominated by the particle movement of secondary electrons this is addressed by means of the PIC code of CST PARTICLE STUDIO®. The breakdown analysis is more a plasma effect and will be analyzed with CST MICROWAVE STUDIO® using a non-linear Drude model. Different examples such as filters, diplexer or simple coaxial cable are used to illustrate the functionality. Some special aspects as saturation of particles, distortion of signals, usage of arbitrary time signals or alternative detection criterion will be addressed as well. Last but not least the link to SPARK3D from Aurorasat will be shown. Dr Monika Balk graduated in 2000 at the Gerhard-Mercator-University Duisburg, Germany, in high frequency engineering. She then got her Ph.D. at Technical University of Darmstadt, Germany, in 2005 with an accelerator physics related topic. Since 2005 she … [Read more...] about Multipaction & Breakdown Analysis of RF Components
In this webinar we will review the RF Breakdown effects which can occur in space hardware namely multipactor discharge. The webinar will focus on the advantages of using full numerical approaches instead of analytical ones to determine the breakdown power level. Situations in which analytical approaches are not valid will be pointed out, as well as practical cases in which the analytical calculation significantly underestimates the breakdown power level. Simulations with SPARK3D and CST PARTICLE STUDIO® coupled with CST MICROWAVE STUDIO® will show the benefits of using a full numerical approach to tackle these problems in space applications. PRESENTERS: Carlos Vicente received the PhD. degree in Telecommunications Engineering in 2005 from the Technical University of Darmstadt, Germany. In his Doctoral Thesis, Dr. Vicente did research on high power effects in Communications Satellites such as RF Breakdown and Passive Intermodulation. In 2006, he co-founded the company Aurora Software … [Read more...] about Getting Ahead with RF Breakdown Simulation for Space Hardware
If Americans feel a little left out when it comes to all the goodies that are being launched in Korea on a daily basis, Canadians sometimes feel just as left out when it comes to mobile entertainment when compared to what is offered south of the border. Well, people sporting the maple leaf no longer need to ask, "When can we have a V-Cast like service?" because Telus has launched its Mobile Music service. The catalogue of songs available is far-reaching, with offerings from artists signed by EMI Music, SonyBMG, Universal, and Warner. This announcement is accompanied by Telus also becoming the exlusive carrier of the LG 8100 handset, a "mobile entertainment and communications device packing an MP3 player, stereo speakers, Bluetooth functionality and much more." There is also a 1.3MP camera on-board, as well as a mini-SD expansion slot. This tune-getting service is the latest in Telus' SPARK solution, which also includes mobile TV, games, and more. Downloads will be fast, thanks to … [Read more...] about Telus Mobility announces music download service
XM Satellite Radio isn't reserved for those standalone units anymore. No longer are you restricted to carrying around an XM-only device to play in your car, while strolling down the street, or even at home… at least if you fall within Telus' service area in Canada. I had the chance to try out their new Telus Mobile Radio service, powered by XM Canada, and while it was a worthwhile experience, the service isn't without its faults. It's a Java ApplicationTelus Mobile Radio is currently available for use on two of Telus' media-centric clamshells - the LG 8100 and the Samsung A950 - and this review is based on the latter, though I suspect the service is much the same on the LG handset (they plan on deploying XM Satellite Radio on other phones a little later). For starters, you are not receiving a true XM Satellite receiver. Instead, you get your live streaming music by making use of the 1X and EV-DO high-speed networks provided by Telus. Because it is a Java application (that you … [Read more...] about REVIEW: Telus Mobile Radio, Powered by XM Canada