Delivering Innovation with Object-Based Analytics
Thu, 25 Mar 2021 18:17:06 -0000
|Read Time: 0 minutes
As analytic workloads continue to grow, more pressure is placed on data teams to build an effective data strategy.
One large financial customer of ours is challenging their data teams to help fight false-positive card declines, which according to Javelin Research costs issuers and merchants over $118B. However, ensuring fraud prevention while cutting down on the false positives can be a fine line to walk. The key to solving this problem with an analytics model is to start with the data.
At Dell Technologies, we have helped our customers work through these challenges for many years, from building fraud detection to enabling life-saving healthcare. We understand that getting the data strategy right can help teams build models to solve their real-world problems. Dell Technologies has engaged in joint engineering and validation efforts to bring our leading distributed object storage product Dell EMC ECS to integrate industry leaders in the Analytics space.
Today we are happy to announce a collaboration with unified analytics warehousing leader Vertica, which will allow our customers to deliver cloud innovation on-premises, greater operational flexibility and efficiency, and scale infrastructure resources independently. Working with Vertica will allow our joint analytics customers to deliver flexible and efficient architecture by separating computer and storage.
Collaborating on Object-Based Analytics with Vertica
Vertica is a unified analytics warehouse built to deliver blazing-fast query performance regardless of scale or concurrency requirements. It is a highly scalable analytical database that works well in many deployment situations – on-premises, on top of a Hadoop or S3 data lake, and in any public clouds. Vertica features powerful SQL-based analytics, time-series, geospatial, and in-database machine learning capabilities. Vertica removes typical barriers to analytics for some of the world’s most prominent data-centric organizations.
Vertica in Eon mode decouples compute from storage to give customers the benefits of cloud architecture for analytic workloads. Previously only available in the public clouds, Vertica now offers Eon Mode with superior on-premises object storage solutions.
“Our customers trust us to provide the greatest freedom in how they consume the highest performance analytics – flexibility for the broadest deployment options, whether it’s deploying Vertica on any major public cloud or on-premises with more leading object storage options,” said Colin Mahony, senior vice president and general manager of Vertica.
Help Data Teams Solve Real World Problem
Data Teams can begin taking advantage of our joint collaboration today. Today’s announcement allows customers to:
- Vertica in EON Mode for Dell EMC ECS delivers cloud innovation on-premises.
- Separate compute and storage with ECS + Vertica EON Mode for delivering operations flexibility and efficiency.
- Scale infrastructure resources independently. Storage can grow without adding expensive compute, and compute can be scaled up or down with variable or intermittent workloads.
Vertica in Eon Mode for Dell EMC ECS gives companies a consistent platform for analytics across all of their environments, whether their data resides in the cloud or on-premises, or in a hybrid architecture. Check this white paper to learn about the technologies and environment used to confirm compatibility between Vertica in Eon Mode and Dell EMC ECS platform.
Related Blog Posts
Dell and Databricks Announce a Multicloud Analytics and AI Solution
Mon, 22 May 2023 16:58:09 -0000
|Read Time: 0 minutes
Dell and Databricks' partnership will bring customers cloud-based analytics and AI using Databricks with data stored in Dell Object Storage.
The biggest business opportunity for enterprises today lies in harnessing data for business insight and gaining a competitive edge. At the same time, the data landscape is more distributed and fragmented than ever. Data is spread out across multiple environments including on-premises and multiple public clouds, thus complicating the ability to access and process data efficiently.
Enterprises require solutions that enable a multicloud data strategy by design. That means leveraging data wherever it is stored, across clouds, with a consistent management, security, and governance experience to build analytical and AI/ML-based workloads.
At Dell, the business of data is not new to us. We store and process a large majority of the world’s data on our systems. And we work with customers across the globe every day to accelerate time to value from their data. Dell is building an open ecosystem of partners who together can help address next-gen challenges in data management.
Dell and Databricks
Today, during the opening keynote at Dell Technologies World 2023, Dell Technologies announced a strategic and multi-phase partnership with Databricks.
I want to share some additional details around that announcement.
Customers today can leverage native Databricks capabilities to process, analyze and share data stored in Dell object storage, located on-prem or in a cloud-adjacent datacenter like Faction, without moving data into the cloud. This unlocks phenomenal benefits for customers including compute on-demand to process on-premise data assets, the ability to securely share data within and outside the enterprise, reduced data movements and copies, compliance with data localization regulations, multicloud resiliency, the adoption of open architecture standards and an overall reduction in cost and complexity of their data landscape. Key to this integration is support for Delta Sharing, an open standard for secure sharing of data assets to securely share live data with any computing platform.
And that’s not all - our teams at Dell and Databricks are excited to engineer a deeper integration that will deliver a truly seamless experience of using Dell object storage within the Databricks Lakehouse Platform. This will completely transform the way customers manage on-premises data with cloud platforms.
Dell and Databricks realize it is a multi-faceted world, and customers benefit from being able to access data wherever it resides to unlock competitive differentiation. Dell and Databricks will closely partner in the market to bring these solutions to our joint customers.
“Databricks is focused on helping businesses extract the most valuable insights from their data, wherever it resides,” said Adam Conway, senior vice president, product at Databricks. “This partnership provides the ability to leverage cloud and on-premises data together with best-of-breed technologies, and to securely share that data through Delta Sharing. Combining the best of Dell and Databricks changes the data landscape for customers as they operate in today’s multicloud world.”
Data Management with Dell Technologies
This partnership is a great addition to Dell’s open ecosystem of technologies in the data space. Together with Dell’s market-leading portfolio of storage, compute and services, this ecosystem aims to provide the best-in-class data management solutions to our customers and help them build a multicloud data strategy by design. The data space is buzzing with new innovations and technologies and aimed at improving the user experience, productivity, and business value by orders of magnitude. Partner with Dell Technologies to create the right multicloud data strategy for your enterprise and unleash the next wave of transformation and competitive edge for your business. Visit us at dell.com/datamanagement to stay tuned to the latest in this space.
To learn more about how Dell and Databricks can help your organization streamline its data strategy, read the "Power Multicloud Data Analytics and AI using Dell Object Storage and Databricks" white paper, or contact the Dell Technologies data management team at Dell.data.management@dell.com.
Introducing ObjectScale 1.4.0: Elevating Enterprise Object Storage
Wed, 17 Apr 2024 14:00:00 -0000
|Read Time: 0 minutes
Dell Technologies is excited to unveil the latest iteration of its object storage solution, Dell ObjectScale 1.4.0. Engineered to cater to the rigorous requirements of enterprise-level storage, Dell ObjectScale 1.4.0 boasts a software-defined and containerized architecture. This advanced design ensures exceptional reliability, performance, and scalability, further solidifying Dell Technologies' dedication to delivering superior storage solutions.
Dell ObjectScale offers diverse deployment options that cater to a plethora of infrastructural needs, providing flexibility and efficiency in management and scaling enterprise object storage.
New features in Dell ObjectScale 1.4.0
Dell ObjectScale 1.4.0 introduces a host of new features and enhancements aimed at improving serviceability, security, and manageability:
Monitoring and reporting enhancements
The enhanced management API offers comprehensive monitoring capabilities, allowing for better visibility into cluster status, node-based inventory details, and component health. Additionally, new audit messages for cluster user set password events and new alerts for successful and failed jobs have been introduced. Users can now access various functions through the ObjectScale portal or a REST client, enhancing serviceability and oversight. This enhancement benefits administrators by enabling proactive maintenance and troubleshooting and ensuring optimal performance.
Dell ObjectScale portal improvements
The portal now provides a complete inventory of all nodes, disks, pods, and PVCs, coupled with enhanced Grafana UI dashboards for in-depth data visualization and performance monitoring. This improvement aids in efficient resource management and planning, allowing administrators to make informed decisions and optimize cluster performance.
S3 bucket deletion
A new API facilitates the deletion of buckets containing data, streamlining the process and offering better monitoring capabilities. Previously, a standard S3 bucket could only be deleted if it was empty. The new feature allows for the deletion of non-empty buckets through a background task with configurable speed and resource consumption. This feature is particularly beneficial for use cases requiring frequent updates or deletions of stored data as it simplifies operations and enhances flexibility.
ObjectScale replication – improved performance
Enhancements to the replication framework deliver improved throughput for both small and large objects. These enhancements mitigate the growth of replication backlogs and optimize resource utilization, thereby ensuring data protection without adversely affecting customer applications.
Upgrade and installation enhancements
The refined deployment and installation process, including a reduced package size and streamlined upgrade process, improves the customer experience. The appliance and software bundle deployments provide a 1-click upgrade feature for the application layer, simplifying upgrades and reducing operational complexity and downtime.
ObjectScale ‘As An Application’ improvements
Version 1.4 provides management IAM support for deployments on Red Hat OpenShift, offering a simplified management user experience and a common IAM model across all ObjectScale deployment models. This enhancement is beneficial for organizations using OpenShift as it provides consistent and simplified management across different deployment environments.
Storage reclamation process improvements
The garbage collection (GC) process reclaims space from discarded full chunks or chunks containing a mixture of deleted and non-deleted object fragments no longer referenced. Enhancements to the GC process and verification scanner improve the efficiency of the storage reclamation process. This benefit is crucial for long-term data retention and storage optimization as it ensures efficient use of storage resources and reduces costs.
Security: cipher security update
ObjectScale has upgraded its cryptographic module to BSAFE Crypto-J 6.3, ensuring FIPS 140-2 compliance for Data-at-Rest Encryption. This enhancement is essential for maintaining stringent security measures, providing robust encryption and enhancing data protection.
Platform latest version support
Dell ObjectScale 1.4 now supports the latest versions of Red Hat OpenShift (4.14) and Kubernetes (v1.27), allowing for platform upgrades to the most current releases. This benefit ensures compatibility with and access to the latest features and improvements, enhancing overall system performance and security.
Conclusion
Dell ObjectScale 1.4.0 offers a sophisticated, enterprise-grade object storage solution that is flexible, scalable, and secure. With its robust architecture and integration with Kubernetes, it provides a compelling option for organizations seeking to optimize their object storage infrastructure.
Author: Cris Banson