Connect with us

Features

A FLASHY OUTLOOK

Published

on

Updated : August 3, 2014 00:15  am,
By Editor

img27Flash continues to gain traction throughout the storage landscape as the technology removes several bottlenecks of I/O performance

Flash storage in the enterprise segment is gaining ground for very obvious reasons. Reduced costs of Flash memory are making it conceivable to have more data stored on Flash arrays. Several bottlenecks in traditional enterprise data center storage have caused an acceleration towards flash storage arrays as a general trend in data centers globally. Leading vendors including EMC, Hitachi, IBM and so on have added flash drives to their existing arrays.

With application performance and availability top priority for Businesses, Flash helps deliver reduced data processing times and faster application service uptime. Keeping more active content on SSD arrays helps retrieve and deliver that data much faster. This is more in the case of critical applications that need high IOPS (Input /Output Operations Per Second) storage performance. Virtualization and demands of cloud computing are further accentuating the need for Flash storage arrays in enterprise data centers.

According to Pure Storage, a vendor focused on enterprise storage Technologies, there are similar trends in all regions of its business including MEA and therefore a growing demand for Flash arrays. The company’s distributor in the region, Global Distribution FZE has already commenced Partner recruitment and enablement, both Technical and Sales.

Steven Rose VP EMEA Pure Storage says, “In the virtualized datacenter, it is now commonly I/O performance that limits server consolidation ratios, not CPU or memory. These bottlenecks can affect customer satisfaction and slow down business processes. Further, Virtualization has the effect of multiplexing multiple logical workloads across a single physical I/O path. The greater the consolidation achieved through virtualization, the more randomized the physical I/O requests become. And random I/O is the Achilles heel of the rotational disk drive, because seek and rotational latency dominate transfer times 20 to 1.”

While Virtualization randomizes I/O as a variety of IO workloads are run together against the storage stack, the legacy storage based on traditional HDDs is mostly designed for sequential I/O. When a multitude of applications and services are competing against the resources of a spinning disk storage array the response times gets higher and higher and the disk array struggles to keep up as result of bottlenecks caused by the disk contention.

Christian Putz, Vice President-EMEA Channel Sales at Violin Memory, a leading provider of all-flash storage arrays and appliances delivering application solutions for the enterprise says, “Flash technology allows to run random workloads without having backend contention, and specifically speaking, the Violin Memory Flash technology provides sustained, predictable and sub-milisecond latencies for any kind of random workload (even with a huge component of writes). With Violin Memory Flash technology running mixed workloads results in no I/O penalty and allows to fully virtualize business critical applications, sustain high performance for all virtualized databases and applications and fully adopt VDI deployments because of an increased VDIs/core ratio. Last but not least, Violin Memory Flash technology dramatically reduces the impact of overcommitting resources, which typically occurs in this space, and allows to even run more VMs per host with low latency storage.”

According to Steven, while the demand for IOPS is growing, the supply is actually shrinking because the I/O rate to a single hard drive has been roughly constant while the capacity of a hard drive doubles every 18 months or so. This means that their performance per GB is actually declining. Therefore Flash is poised to have a disruptive effect on the enterprise storage market by applying solid state storage to tier 1 applications in the data center.

He adds, “A solid state storage solution based on flash removes these bottlenecks because it has no seek time, no rotational latency, and is equally fast on random workloads as on sequential ones, he says. Flash can accelerate virtual server and desktop deployments while affording higher consolidation and greater efficiency. Flash can also accelerate SQL and NoSQL workloads without partitioning or changes to the application. With flash memory, any block of data can be fetched in nearly constant time. This means that applications can be designed to expect sub-millisecond latency no matter what the I/O stream (random or sequential) or data distribution. Also, Solid state storage uses 10x less power and space than rotational hard drives, allowing you to substantially expand capacity in place. Further, with all flash arrays, customers spend much less time planning and tuning their arrays to remove bottlenecks.”

Flash all the way

Vendors are delivering hybrid arrays that include Flash and hard drives as well as all flash arrays which contain multiple flash memory drives instead of hard disk drives. Industry experts suggest that deployments must take into account use case scenarios. For instance, typical application workloads will see a considerable improvement in performance as well as savings in power, cooling etc with marginal inclusion of flash technology. Therefore, the hybrid approach works out as a viable option to accelerate workload performance. However, there are also application scenarios that demand dramatic improvements in response-time performance (latency) or high IOPS which are well taken care of all Flash array options.

All-flash arrays have been designed from the ground up to work with flash media unlike traditional arrays that have been built to work with the relatively slower spinning hard drives.

Christian says, “All Flash is one of the fastest growing markets in IT infrastructure. Nowadays, real-time data access and operational efficiency are the new norms and IT forces are starting to drive a transformation of the datacenter pushed by the demands of Business Critical Applications, full Enterprise Virtualization adoption, Data analytics, etc. “

He adds, “As Flash storage is a proven and mature technology and we are seeing Tier 1 apps and virtualization driving adoption of flash arrays. VDI, Transactional databases, Data analytics, ERPs, and Cloud initiatives are being moved towards an All-Flash storage to make real-time data access and operational efficiency become a reality: a tremendous boost in performance with dramatically reduced response times allows not only guaranteeing the future business growth pace, but it also provides higher consolidation ratios, to be able to fully embrace business critical application virtualisation, to reduce over-provisioning, to reduce licensing costs by increasing compute node utilization, and an impressive datacenter footprint reduction.”

A great example of the impact of Flash instead of legacy hard disk drives is in a Virtual Desktop environment. According to Pure Storage, one of the biggest challenges VDI presents to storage is the variable and spikey nature of IO requirements throughout the day. Typical use is write-heavy (often 80/20), but boot storms and anti-virus scans introduce huge read spikes. Overnight maintenance tasks (patches, recomposes) introduce even more heavy write bursts. You need storage that keeps up with it all without sacrificing end-user experience the way a caching solution can. This is another great example of where flash really outpaces hard disk drive based hybrid arrays.

Steven elaborates, “Many VDI pilots go well– until it is time to scale-up the deployment and move into production. That’s where too often deployments hit the IO wall – exceeding the IO capabilities of traditional disk storage and requiring expensive additional storage purchases which blow the VDI ROI case. Pure Storage scales seamlessly from pilot of a few hundred to 1,000s of users, all with non-disruptive incremental capacity and resiliency expansion. If all the benefits of VDI (security, consolidation for managent, etc.) can meet or exceed the performance of local laptop performance, then more and more customers will consider to move to Virtual Desktop.”

Salil Dighe, the CEO at Meta Byte Technologies, a regional partner for FusionIO, that was recently acquired by SanDisk claims that the region has been slow and cautious in its adoption of Flash storage as they haven’t seen significant gains from traditional Flash storage options available from different vendors.

He says,The Middle East region is a followers market. The other parts of the world have already tried to utilize flash storage arrays and have not seen much benefit in terms of performance increase or IOPS.  For the investments vs performance the gains are minimal hence now they are turning towards what is known as Flash on PCIe. One such product is FusionIO which seems to turn heads and provides significant throughput in terms of IOPS. Today many of the customers prefer FusionIO due to its flexibility in supporting various scenarios be it increasing the IOPS on a standard tier1 server to server virtualization or to provide significantly high VDI and VM densities on the same servers.“

PCIe (Peripheral Component Interconnect Express) based solid-state storage has better performance than server-based SATA, SAS or Fibre Channel (FC) solid-state drives because of the direct connections.

He adds, “If you are using a disk controller to write on hard drives whether flash or non-flash the bottle neck is still the controller. The difference can only be significant if you use Flash as a memory tier. FusionIO uses Flash memory in its best suited architecture that is flash on PCIe, meaning CPU has faster access to data. As a result the CPU is efficiently utilized and can process many more operations or support more connections.”

The transition in effect

The transition from to flash arrays is bound to accelerate. This would suit the growing virtualized environments as Flash helps customers eliminate bottlenecks of applications delivery in virtual environments. So will hard disk drives have a place in the data centres in the long term?

Responding to that question, Steven says, “In some areas such as deep archive, or areas where performance isn’t a requirement, then hard disks may be here to stay for some period of time. But with the pace of innovation and focus on the flash industry, its anyone’s guess as to how soon even large footprint slow hard disk drives might be replaced by SSD(solid state drives). Consider that in early 2014 the standard Enterprise All flash array SSD was 512GB and by the beginning of 2015 this could be 2TB per SSD and you can see why we could be rid of hard disk drives much faster than most Enterprises anticipate. Therefore we recommend highly that all customers when making their storage refresh plans consider the benefits of an All-flash approach to storage.”

Combining the speed of flash SSDs with the capacity of HDDs has enabled faster access to hot data, while keeping cold data that is not critically needed on high-capacity HDDs. The Flash manufacturers are emphatic that the trend is bound to accelerate.

“We clearly see flash memory as the Tier-1 storage for the enterprise datacenter, as it needs to be offer the highest sustained performance with the lowest possible latency while keeping the lowest cost per I/O. And this is actually starting to be a reality for Violin Memory customers. Traditional hard disk based storage will be still the preferred solution for reference data as it needs to be capacity optimised and needs to offer the lowest possible cost per GB (at the expense of inducing a high cost per I/O),” says Christian.

According to him, the cost benefits of Traditional disk based storage needs to be relooked as traditional disk storage offers the best possible cost per GB but the worst $/Transaction ratio compared to Flash. So price and cost is still a concern when all the variables are not properly set into the equation.

He adds, “Nevertheless, Flash storage is evolving very fast and the fact is that Violin Memory´s technology is even exceeding Moore´s law: flash density and performance is doubling every ~16 months.

Violin Memory´s unique intellectual property is leading the market by continuously developing the next generation of flash technology. This will guarantee continuing the same pace of doubling or even quadrupling the capacity and performance, and when combined with additional data efficiency mechanisms like compression and de-duplication this results in many PBs of Flash with dozens of millions of IOPS per Rack with a lower CAPEX/GB than performance disk. “

According to Dighe, Cost is definitely a big concern and a bottleneck. In order to take advantage of Flash in the most limited budgets, enterprises must look at different architectures and not go by legacy storage providers. They should consider hybrid storage which allows enterprises to take benefit of both Flash as well as HDD’s and can outperform any standard flash enabled enterprise storage in a single appliance.

He says, “Definitely we see customers replacing hard disk and standard enterprise storage with flash technology provided they are able to deliver high performance in a small hardware infrastructure footprint. For example, FusionIO has proved recently that they can achieve 1.1 Billion IOPS using 8 standard tier one servers with one FusionIO drives in each server leading to a quantum leap in terms performance and acceleration, which has never seen before.”

Pure Storage claims that a number of customers that have completely eliminated their legacy hybrid hard disk drive-based arrays in exchange for All Flash Arrays.

“We continue to engage with the thought leaders in many of our Enterprise customers that are seeking advice in terms of planning to eliminate hard disk from their data centres because of the many benefits of All flash storage arrays. Thanks to data reduction techniques such as compression and deduplication implemented by Pure Storage, flash has already become the preferred choice of business critical applications, and that trend is increasing.  Nearly 50% of all flash storage for Pure Storage is made up of database applications because of the ability to get data reduction 3-10X. “

So there it is. Flash enabled datacenters are likely to be one of the major shifts on the IT Infrastructural roadmap.

Continue Reading

Features

Cash and Its Persistent Meaning

Published

on

digital payments

Authored by: Konstantin Vladimirovich Tserazov

In recent years, the global shift towards digital payments has been evident. More countries are witnessing a decline in cash transactions, with Gulf countries upholding this trend. By the end of this year, over half of all financial interactions in this region are expected to be cashless. Despite this tendency, cash remains in the pockets of millions of people, and this phenomenon can’t be ignored.

The Evolution of Money

Before money existed, bartering was used, but it was inefficient. As a result, mediums of exchange were created, beginning with items like shells, which later developed into metals, coins, and eventually banknotes. While this shift towards digital payments offers convenience and efficiency, it also creates challenges for certain groups in any society, such as the elderly, minors, and individuals with disabilities. Even in the face of digitalization, cash remains important for those who cannot access banking services, such as temporary migrants. Unfortunately, these groups face a risk of digital exclusion.

The Cash Dilemma

In some countries, the demand for cash increases even as cash payments decline. This can be explained by the fact that cash is used sometimes as a preferred savings method, especially during times of crisis.

The push towards cashless and digital payments is driving a reduction in physical bank branches, encouraging the transition to digital money.

However, this transition faces several obstacles:

  • High Cost of Smartphones: Not everyone can afford a smartphone, which is crucial for conducting digital transactions.
  • Unreliable Internet Access: Consistent Internet connectivity is necessary for digital payments, yet it is not universally accessible.
  • Challenges for Older Adults: Seniors may struggle to adapt to digital payment systems.
  • Fraud Risk: Ease of transfer increases fraud risk, especially for vulnerable groups.
  • No Local CBDCs: Many countries lack central bank digital currencies (CBDCs).
  • Unclear Crypto Laws: Cryptocurrency laws are often unclear or restrictive.

Cryptocurrency as a Potential Solution

Cryptocurrencies could potentially address some of these challenges, but it is essential to ensure that the development of CBDCs and the broader crypto ecosystem includes applications for the deaf, blind, or visually impaired, as well as individuals with developmental disabilities.

This area currently receives little attention in the crypto sphere but holds the potential for successful business models and innovative solutions for millions of people. Ultimately, these solutions will contribute to the adoption of digital means of financial interaction.

The Necessity of Digitization

The move towards digitization aligns with the Environmental, Social, and Governance (ESG) agenda for money emission. Managing cash incurs costs for the state, and a digital system should be significantly more efficient than handling physical cash, which requires transport and management. The marginal cost per transaction would be very low if the central bank provided a digital payment system.

Moreover, if CBDCs were interest-bearing, they could theoretically impact monetary policy quicker. This would make it more advantageous to hold money in CBDCs rather than cash, which does not generate income.

Digital Money as a Tool for Inflation Management

When high interest rates are necessary to curb inflation, digital money could become a silver bullet. The circulation of such financial instruments reduces business costs, allowing them to raise prices less.

In short, the distribution of CBDCs could be as effective a tool for central banks in managing inflation as increasing key interest rates and tightening reserve requirements for banking activities. Unlike cash, where it is unclear what goods are being purchased at any given moment, CBDCs provide for monetary policy makers transparency in transactions .

Why People Still Prefer Cash

Despite the advantages of digital payments, many people still prefer cash. This preference can be traced back to when dollars had guaranteed gold backing. When thinking about digital currencies and cryptocurrencies, some feel they are “somehow out of thin air,” not backed by anything.

In reality, current fiat currencies are also not backed by anything. However, cryptocurrencies like Bitcoin have a guaranteed reduction in the rate of issuance and a “cap” on the maximum number of units that can be issued, unlike any fiat currency.

The inflationary nature of fiat encourages even those who save in cash to spend it. If a person saves in Bitcoin, there are no such incentives; due to its deflationary model, there is a high likelihood of further increases in the value of such cryptocurrency relative to fiat money. This is precisely why the adoption of Bitcoin as a means of payment is stagnating — in El Salvador, for example, despite the ability to pay with Bitcoin in stores, there is no significant enthusiasm.

Another interesting point about why people prefer cash is the relative anonymity of spending. Additionally, there is the feeling of control. In some countries, there is a strong fear that hard-earned money in banks could disappear during a financial crisis. The Cypriot banking debacle of 2012-2013 serves as a chilling reminder. Billions of euros—a staggering €8 billion—were simply wiped out, leaving depositors high and dry. Fast forward a decade, and a glimmer of hope emerged: last year a Cypriot court ordered the government to make amends to one unlucky depositor. But whether this lone victory will set a precedent for broader compensation remains a major question mark.

The Convenience of Cash

There are many instances where, if you travel to another country, you can often pay with your home country’s bank card. However, the exchange rate is a significant question. Additionally, there are built-in fees. In some cases, carrying cash from your home country and exchanging it locally can be more beneficial than using a card or ATM.

Sure, digital payments are all the rage, but cash still holds its own. It’s secure and private and gives you a sense of control. If we go completely cashless, some people will get left behind. We need to embrace the new while still holding onto the old. That’s how we build a financial system that works for everyone.

Continue Reading

Features

Paving the Way for AI Success in Business

Published

on

AI in business

By Karim Azar, Regional Vice President – Middle East & Turkey, Cloudera

The digital landscape is evolving at an unprecedented pace, and at the heart of this evolution lies the transformative potential of artificial intelligence (AI). Across industries, AI is not merely a buzzword but a revolutionary force driving innovation, efficiency, and growth. Its impact extends beyond automation, touching every side of business operations and decision-making. It can revolutionize multiple sectors and fundamentally reshape the corporate industry.

Nonetheless, challenges arise with technological evolution, particularly in accessing and overseeing varied datasets across diverse environments. These challenges frequently act as obstacles to achieving successful AI implementation. In response to these challenges, the technology landscape is witnessing significant advancements in open data lakehouse technologies, providing a robust foundation for AI and analytics. Let’s delve into key technological developments and their advantages, focusing on the broader implications rather than specific products.

Unlocking Business Potential

AI has the potential to unleash new opportunities for businesses. McKinsey’s findings reveal that more than 62% of companies in the Gulf Cooperation Council (GCC) region currently utilize Generative AI in some operational aspect. The research underscores the substantial potential of AI to create tangible value in the GCC, with an estimated value of up to $150 billion.

This adoption trend is not without merit; statistics show that 83% of businesses adopting AI report substantial (30%) or moderate (53%) benefits. AI can address various challenges by providing predictive analytics and personalized customer experiences, enabling organizations to make faster and more accurate data-driven decisions.

Despite the obstacles in adopting AI, such as data management complexities and security concerns, offering air-gapped deployment for large language models (LLMs) is still a viable option. This feature boosts security, data privacy, and performance while also lowering customer operational expenses. However, overcoming these challenges requires more than just technological solutions. It demands a comprehensive approach that includes robust data governance frameworks, continuous employee training programs, and collaboration with regulatory bodies to ensure compliance with data protection laws.

AI Across Industries

AI is not a one-size-fits-all solution. It is applied differently across industries and business functions, including healthcare, finance, manufacturing, and retail. The potential uses of AI are vast, from boosting supply chain efficiency to transforming healthcare outcomes and customer service.

For example, in the healthcare industry, AI-powered predictive analytics can help doctors identify patients at high risk of developing certain diseases, allowing for early intervention and personalized treatment plans. AI algorithms can analyze market trends and financial customer behavior to recommend customized investment strategies. In manufacturing, AI-driven predictive maintenance can proactively anticipate equipment failures and schedule maintenance activities, minimizing downtime and reducing costs.

As businesses increasingly adopt AI, they invest in their organization’s future. By promoting innovation and agility, companies can leverage AI to maintain competitiveness in a digital era. Prioritizing data privacy and security helps build trust with customers and stakeholders, ensuring AI technologies’ responsible and ethical use.

AI is a significant transformation in how businesses function and innovate. Embracing AI opens up vast opportunities for organizations to reshape their operations, stimulate growth, and influence the future of business. While the journey may present challenges, the potential benefits are boundless for those willing to embrace the power of AI.

Continue Reading

Features

Smart Cities and the Rise of Intelligent Transportation Systems: Exploring the Benefits and Risks of Vehicle Surveillance

Published

on

By: Dr Ryad Soobhany, Associate Professor, School of Mathematical & Computer Sciences, Heriot-Watt University Dubai

Intelligent Transportation Systems (ITS) have emerged as a transformative solution in urban areas, tackling challenges such as high traffic and pollution. These systems, incorporating a network of static and mobile sensors, including cameras on buildings or vehicles/drones, embedded in the smart city infrastructure, are revolutionizing traffic management. By harnessing data from cameras, in-vehicle GPS systems, in-vehicle Near Field Communication (NFC), IoT devices, and Artificial Intelligence (AI), ITS enable the monitoring and tracking of vehicles for Intelligent Traffic Management Systems (ITMS) or Public Transportation Management Systems (PTMS).

While intelligent transportation systems offer significant benefits, it’s crucial to acknowledge the challenges and risks they pose. ITMS provides real-time monitoring of traffic on roads and at junctions, while PTMS focus on managing transportation fleet and passenger information services. Emergency Response Management Systems (ERMS) primarily monitor the emergency responders of the smart city. The use of intelligent vehicle surveillance systems improves traffic management, public safety, and urban planning, but it also raises concerns about the data privacy and security of users and infrastructure, a risk that must be carefully managed.

Benefits

There are several benefits from the implementation of vehicle surveillance systems in urban areas and the most obvious one is a better vehicle traffic flow by using ITMS. Cameras placed strategically across the city monitor traffic to identify congested areas and road traffic incidents (e.g. accidents). Implementing dynamic traffic lights systems at junctions and temporary speed limits can improve traffic flow. Using AI, predictive traffic routing forecasts traffic bottlenecks and suggests alternative routing.  The use of PTMS leads to enhanced scheduling of public transportation; for example, the arrival/departure of trains/metro at the station is synchronized to feeder buses or taxis being stationed outside the station. There is an improvement in customer satisfaction and journey planning with real-time updates for public transport. Traffic flow is also improved by monitoring of cycle and pedestrian lanes, where safer cycle lanes will encourage road users to adopt cycling in certain urban areas adapted for cycling.

There is an overall improvement in public safety by better traffic management, with better response time to emergency situations by the ERMS, such as ambulances. LPR/ANPR (Licence Plate Recognition/Automatic Number Plate Recognition systems and GPS tracking systems in cars allow the monitoring of vehicles while they are located withing the bounds of the smart city. Stolen or wanted vehicles can be detected and followed through the city. The use of surveillance cameras, LPR/ANPR systems and GPS tracking can improve identification of criminal activities, which should enhance the response of law enforcement. Under-Vehicle Surveillance Systems (UVSS), which are cameras placed at strategic places on roads in the city take pictures or videos of the underside of vehicles to check the chassis for stolen cars. UVSS can also be used to detect contraband at ports or entry/exit points in smart cities.

The use of LPR/ANPR systems ease the management of Low Emission zones, which are areas where low emission vehicles (e.g. electric or hybrid vehicles) can circulate without charges and vehicles with higher emission rates have to pay an hourly or daily charge. The implementation of Low Emission zones can bring environmental benefits. The improved traffic flow in the urban areas can also lead to environmental benefits with less emissions in traffic jams and long traffic queues at junctions. Apart from environmental benefits, there are economic benefits linked to better health and overall happiness of citizens and visitors.

Risks

Several risks are associated with the amount of data collected from the vehicle surveillance systems. The main concern is the privacy of the smart city’s car drivers and car owners. Vehicles and their drivers are tracked everywhere they travel around the city and the speed they travel. This can lead to tracking drivers and without proper legal frameworks, the data collected can be used to encroach on the users’ privacy. The large amount of collected and stored data can be quite attractive to cyber criminals and might lead to cyber-attacks. Any data breach from these attacks might expose the personal information of drivers and their vehicles. Cyber-criminals can target the surveillance systems, for example hacking the intelligent dynamic traffic speed system and changing the traffic speed around the city.

Having video surveillance around the urban areas recording the public can lead to ethical issues. Most of the time, drivers might not have provided informed consent to participate in the vehicle surveillance systems. The lack of consent from users can lead to non-compliance with regulatory bodies and can result in legal challenges from user groups. Users need to be made aware that they are entering a vehicle surveillance zone and their data might be recorded. Vehicle surveillance systems can be used to discriminate against certain sections of the community, for example, young drivers might be unfairly targeted by the vehicle surveillance systems because they allegedly drive fast and dangerously, which allegedly cause accidents. Any cyber security attack or data intrusion can lead to users losing trust in the vehicle surveillance system.

The use of vehicle surveillance systems can benefit smart cities and enhance the quality of life of residents and visitors, but the authorities must respect the personal privacy of the public by ensuring that data are collected and processed ethically and guarded against any cyber-attack. Security policies and mitigation plans are primordial for vehicle surveillance systems.

Continue Reading

Trending

Please enable JavaScript in your browser to complete this form.

Copyright © 2023 | The Integrator