Posts

Intelligent Transportation Ecosystem

IoT, ITS, and the Talksum Ecosystem

Dale Russell, CTO, Talksum, San Jose

 

We’ve been hearing a lot about of Internet of Things (IoT) for the last decade. IoT is coming, IoT is here, IoT and Big Data…

 

Many of the people talking about IoT are from the computer industry. They’re selling us on a new market valued around $1.7 Trillion in 2020. While convincing us to invest in the IoT sector they will then point to a repackaging of a computer or data center solution. You can buy several brands of set top-media players listed as an IoT device. Upon further inspection they’re a small computer with a HDMI connector and a wireless network card connecting to a web service. Smart watches are but Bluetooth devices for your smart phone; a computer accessory. We have gone from Internet Hosting, Web Services, Cloud Services, and now IoT by  just a release of smaller computers and distributed web services?

 

That’s beginning to change and the consumers will be driving the market so to speak. We want self-driving smart cars! Automobile manufactures old and new are all working on developing self-driving modules, most governments want Intelligent Transportation Systems (ITS), and we as the consumer want gadgets!

 

What gadget is cooler than self-driving cars?

 

The consumer’s desire is to also bring infotainment and entertainment, social groups, smart devices, as well as personal data contracts and other services along for the ride. When you combine all the wants of the consumer we have the beginning of the Digital Transportation Eratm. We want self driving cars, traffic re-routing for first responders, reduced traffic congestion, quieter roads, and cleaner air. With all of these wonderful goals the automobile has become the consumers’ mobile data center bringing all of the same security concerns as an internet data center and many more. Automobile manufacturers, government and regulatory bodies, insurance and telematics services, and internet media providers all bring their own protocols into this new mobile data center. The new Smart Car will need to be considered part of the larger ITS and IoT clouds.

Intelligent Transportation Ecosystem

To meet the challenges of the Digital Transportation Eratm the vehicle needs to be an integral part of these new ecosystems. The Intelligent Transportation Systems will include new networks, data management, and new standards and protocols such as: Vehicle to Vehicle (V2V), Vehicle to Infrastructure (V2I), Signal Phase and Timing (SPaT), and many yet to be legislated. These signals must be introduced in a manner that ensures validity and security to protect against DDoS attacks against these public networks. The introduction of Internet Services, Fleet Management, Insurance, and Telematics into this mobile data cloud also requires that firewalls and gateways are needed to ensure that the automobile is securely protected.

 

Automobiles already generate large streams of data from in-vehicle busses measured in gigabytes an hour. The additional radios, GPS, mobile carriers, infotainment systems, and self-driving systems will make data management and security to this new mobile cloud platform a must.

 

Some of the Challenges:

 

  • Cybersecurity Protection from DDoS, Man in the Middle, and other Internet Attacks
  • Real-time Validation and Insights from these Data Streams
  • Normalization of Standards and Protocols (CAN, LIN, I2C, WAVE, OpenXC, ASN.1…)
  • Extensible Design for Future Standards and Protocols (NHTSA)
  • Regulation Compliance

 

At Talksum we deliver a real-time scalable ecosystem that answers these concerns. Talksum is a Data Routing Engine that is deliverable as a Data Center solution, as a Virtual Router for Cloud deployment, as well as Embedded on select ARM, AARCH64, and customers’ boards. The Talksum product family provides a scalable and holistic ecosystem from the Dashboard to the Data Center.

 

We will be presenting this spring and summer at several conferences where will be discussing the Talksum Ecosystem. Until then follow this blog as next we will discuss the overlaps of the above networks and ecosystem requirements.

A Talksum Perspective – Making Big Data Implementations Successful

Alex VarshavskyAlex Varshavsky, CEO, Talksum

In a recent Capgemini Consulting report entitled Cracking the Data Conundrum: How Successful Companies Make Big Data Operational, it was noted that global organizations spent over $31 billion on Big Data in 2013 and the amount of spend is predicted to reach $114 billion in 2018. Nearly 60 percent of the executives surveyed for the report believe that Big Data will disrupt their industry in the next three years.

The report goes on to state, however, that even though these global enterprises embrace Big Data, only 13 percent have achieved full-scale production of their Big Data initiatives. This begs the question – what is keeping them from full-scale production and operational success?

The report revealed these challenges:

  • Scattered silos of data.
  • Ineffective coordination of analytics initiatives.
  • Lack of strong data management and governance mechanisms.
  • Dependence on legacy systems to process and analyze the data.

We’ll look at each of these challenges and how the Talksum data management solution can help overcome them.

 

Scattered Silos of Data

The report noted that 79 percent of those surveyed had not fully integrated their data sources across the organization. This lack of integration created barriers to a unified view of data that prevented decision-makers from making accurate and timely decisions. In the report, Filippo Passerini, CIO of US-based consumer products leader P&G, said “To move the business to a forward-looking view, we realized we needed one version of the truth. In the past, decision-makers spent time determining sources of the data or who had the most accurate data. This led to a lot of debate before real decisions could be made.”

The Talksum solution handles massive amounts of disparate data that originates from multiple sources. The single RU device ingests the data, sorts and filters it, and makes it useful for a holistic view of the data resources. This allows enterprises to apply business logic early in the process before the data is even stored, and optimizes what needs to be acted upon in real time and what needs to be routed to respective downstream sources. The Talksum Data Stream Router (TDSR) gives all applicable entities a holistic view of the information and breaks down silos that create barriers for knowledge, insights, and action.

 

Ineffective Coordination of Analytics Initiatives

The Capgemini report noted, “A major stumbling block is a lack of adequate coordination among analytics teams.” Scattered resources and decentralized teams break down best practices that can be shared among the groups. As Eric Spiegel, CEO of Siemens USA, puts it, “Leveraging Big Data often means working across functions like IT, engineering, finance, and procurement, and the ownership of data is fragmented across the organization.”

Different teams often have different analytics systems and BI tools. After the TDSR makes sense out of the incoming information, the TDSR then data reduces, enriches, analyzes, and contextually routes the data – in real time – to where it is supposed to go. Engineering receives the information relevant to them; finance receives the information relevant to them; and so on. In addition, all of the data can be stored for archival purposes in case it is needed later. If multiple organizations need the same data, it is delivered to both. Organizations receive data on a need-to-know basis.

 

Lack of Strong Data Management and Governance Mechanisms

Coordination and governance become significant when dealing with implementation challenges. Twenty-seven percent of those surveyed sited ineffective governance models for Big Data and analytics. And coordinating data at ingestion and output needs the right data management capabilities. Talksum is a leader in high-speed data processing and management solutions whose mission is to develop new ways of processing, routing, and managing Big Data. This is another way saying that we are a data management company – first and foremost. A significant benefit of the Talksum data management solution is built-in governance. The TDSR includes the foundational components for governance, regulatory compliance, government standards, and policy control.

 

Dependence on Legacy Systems to Process and Analyze the Data

Of those who responded to the Capgemini survey, 31 percent said their organization was dependent on legacy systems for data processing and management. It’s hard for these organizations to switch to newer systems for fear of incompatibility, of losing data, and of losing time.

The inventors of the Talksum solution have taken this into consideration and built it into the product. The TDSR is compatible with both legacy and newer systems. The unit slides into a server room rack without the need for extensive and complicated coding (it only requires some configuration settings). The unit can output data to both legacy and newer systems, including SharePoint, MySQL, AWS, MongoDB, Hadoop, in-memory options, and others.

 

Talksum Offers More Than Successful Big Data Implementation

To sum it up, the Talksum solution offers more than making Big Data implementations successful; the Talksum solution can also save enterprises up to 80 percent of what it costs to build and run a data center by providing the following:

  • Operational efficiency.
  • Systems interoperability.
  • Infrastructure footprint reduction.
  • Policy compliance.
  • Added security.

To learn more about these, contact us and we’ll send you more information.

Click here for more information about the Talksum product and its features.

 

Data Science as a Solution

Dale Russell, Talksum CTODale Russell, CTO, Talksum

As our understanding of data science problems evolves, we find that effective solutions apply a systematic approach to testing, measuring, and building knowledge of the whole data system. In order to effectively and efficiently create this holistic view of data, first consider the entirety of the data landscape from Infrastructure to Layer 7. A comprehensive data science solution should not have biased access to data from any one layer more than another. When architecting a solution, keep in mind that business requirements will change, message types and objects will change, and the volume of data from various OSI layers will change, especially as the Internet of Things (IoT) becomes more of a reality.

To best deal with an ever-changing data landscape, follow this important principle: Never leave work for a downstream process. Datasets will continue to grow in volume and diversity, and solutions will be expected to take less time to process data or make it actionable. Store-and-sort is a costly strategy regardless of who owns the infrastructure. We found the best approach is to sort first, then store.

Over the last 15 years, exceptional and innovative storage solutions have been developed utilizing distributed software and socket libraries and advanced cloud services. These come with substantial performance increases, benefiting data center environments where concerns about latency, growing storage, or increased demand for analytics on datasets arise. As innovations in this sector brings more data into your landscape, you can enable great data science by taking a broader approach.

While some solutions focus on a subset of problems, a great data science solution deals with the entirety of information across the data landscape. In working with our customers and partners, we found that any acceptable solution must not only accommodate changing data requirements, it must do so in a manner that maintains the highest level of data fidelity. If new analytical processes are created, the solution should easily direct the correct data streams to new processes without a lot of work for your team.

A proper data science solution empowers the organization to focus on asking forward-looking questions of their data, not requiring them to constantly invest time searching for new data solutions every time the data landscape changes (as it will continue to do).

 

 

U-2 Spy Plane Causes LAX to Shut Down; Could Have Been Avoided

Alex VarshavskyAlex Varshavsky, CEO, Talksum

A few weeks ago, I was at the San Jose Airport (SJC) waiting for a commuter flight to Los Angeles (LAX) when a voice came over the loud speaker to announce that the flight had been cancelled. Passengers were told to take a shuttle bus to the San Francisco Airport (SFO) and proceed from there. The next day, I searched for reasons why the flight was cancelled and found out that data from a U-2 spy plane’s flight plan “confused software” that helps track and route aircraft around the region.

When that system failed, a backup helped safely guide flights already in the air, but hundreds of flights across the nation headed for Southern California were either cancelled or delayed as the air traffic control facility north of Los Angeles effectively rebooted.

U-2 Spy Plane Causes LAX to Shut Down; Could Have Been AvoidedIn an Associated Press article, it was reported that the spy plane, which was conducting training operations in the area, flies at about 60,000 feet under “visual rules.” According to the FAA, a computer perceived a conflict between the altitude and the use of visual flight rules, and began trying to route the plane to 10,000 feet to avoid flight collisions. The number of adjustments that would need to be made to the routes of other planes throughout the area overwhelmed the software.

When the system went down, air traffic controllers had to manually call their counterparts at other centers to update them on each plane’s flight plan.

The Talksum Data Stream Router (TDSR) handles cases such as this through its real-time, cross-domain data management function. Not only would the TDSR ingest data, filter it, and route the alerts, in real time, to the various air traffic controllers, it would also reduce the data so as not to overload the system and overwhelm the software and, simultaneously, route the complete data stream to another database for analysis and archiving.

A single TDSR processes millions of complex events per second, in real time, and simplifies the data management process by making it easy to monitor, analyze data, and send alerts in real time while significantly reducing the cost of post-acquisition, ETL integration, and distribution. It is highly configurable without the need for specialized coding to deploy highly specialized solutions such as this. In addition, the Talksum Data Stream Router includes foundational components for regulatory compliance, government standards, and policy control.

Click here for more information about the TDSR, or visit our Contact Us form to request a meeting.

 

Talksum Announces Cross-Domain Data Management Solution for Oil and Gas Exploration and Production

« Back to Press Releases

San Francisco, CA — October 16, 2013 — Talksum, Inc., a leader in real-time data processing solutions, today announced its high-speed cross-domain data management solution for oil and gas exploration and production. Designed to accelerate real-time decisions, the Talksum solution improves data acquisition and transformation, and converts data into flexibly managed event streams, tailored for cross domains such as exploration, extraction, navigation, distribution, communications, health and services, refinery control, and others within the oil and gas sector.

The Talksum cross-domain solution handles data sets at the well site, remote units, regional sites, headquarters, and at the real-time operation center (RTOC) level and can format data in real time, as well as enrich data by correlating events with other external data sources.

The Talksum Data Stream Router – TDSR – filters, data reduces, monitors, aggregates, enriches, analyzes, and routes live streams to power, in real time, data sensor information and alerts such as flow rate, fluid pressures, casing seals, blowout preventer integrity, fracture gradient conditions and pore pressure, gas detection, and other safety and efficiency mechanisms, and routes the relevant data to the respective locations. The TDSR data management solution offers a systems approach, which integrates multiple domains that together assess and potentially affect overall well integrity and safety.

“Oil and gas engineering, production, and operations are exceedingly complex and depend on a wide range of technologies and a large number of contractors and service providers with disparate types of data,” said Alex Varshavsky, founder and CEO of Talksum. “In a cross-domain scenario, the TDSR solution would ingest the different types of data, allow the data to “talk” to each other, and intelligently route relevant parts to the appropriate real-time BI tools, dashboards, and respective databases at the well site, remote units, RTOC, and so on, for immediate action. In addition, pertinent parts of the data flow would be streamed to other cross domains such as health services, insurance companies, and the like, to minimize latency.”

The TDSR can be used for cyber security, a difficult task that must account for different transports, syntaxes, structures, and content. “It’s critical to implement mechanisms for detecting, deterring, and analyzing security events in real time – no matter where they originate from or what they affect,” said Varshavsky. “The TDSR offers an efficient and cost-effective way to accomplish this.”

In addition to cross-domain data management, the Talksum product includes foundational components for changes in government regulations and standards, as well as for policy control.

 

About Talksum

Talksum, Inc. is a leader in high-speed data processing and management solutions whose mission is to develop new ways of processing, routing, and managing Big Data. The Talksum Data Stream Router provides a real-time streaming data solution that is perfect for Big Data initiatives that require massive amounts of data processing.

Connect with Talksum via Facebook, Twitter and LinkedIn.

###

Press contact:
Talksum Inc.
Barry Strauss
Head of Marketing
barrys@talksum.com
415-580-2489

« Back to Press Releases