In a previous blog post, I demonstrated combining the power of SAS Event Stream Processing (ESP) and the SAS Quality Knowledge Base (QKB), a key component of our SAS Data Quality offerings. In this post, I will expand on the topic and show how you can work with data from
The SAS Quality Knowledge Base (QKB) is a collection of files which store data and logic that define data cleansing operations such as parsing, standardization, and generating match codes to facilitate fuzzy matching. Various SAS software products reference the QKB when performing data quality operations on your data. One of
In DataFlux Data Management Studio, the predominate component of the SAS Data Quality bundle, the data quality nodes in a data job use definitions from something called the SAS Quality Knowledge Base (QKB). The QKB supports over 25 languages and provides a set of pre-built rules, definitions and reference data
In DataFlux Data Management Studio, the data quality nodes (e.g., Parsing, Standardization, and Match Codes) in a data job use definitions from the SAS Quality Knowledge Base (QKB). These definitions are based on a locale (Language and Country combination). Sometimes you would like to work with multi-locale data within the
SAS' Julia Florou-Moreno shows you how to use generative AI to build a digital assistant that interacts with a model using natural language conversation.
In the digital age, the adage "knowledge is power" has evolved into "data is power." It reflects the immense value of high-quality data and a strategic approach to data management. At the heart of any successful modern enterprise lies a robust data strategy coupled with stringent data quality standards. For
Amid historical and structural barriers, “quality cancer treatment for all” is a simple credo that is not easy to put into action. Cancer is recognized as a leading cause of death, accounting for more than 10 million deaths globally in 2020, according to the World Health Organization. Globally, people with
Learn the nuts and bolts of how to measure data quality from expert Jim Harris.
When using conventional methods to access and analyze data sets from Teradata tables, SAS brings all the rows from a Teradata table to SAS Workspace Server. As the number of rows in the table grows over time, it adds to the network latency to fetch the data from a database
SAS Data Preparation 2.1 is now available and it includes the ability to perform data quality transformations on your data using the definitions from the SAS Quality Knowledge Base (QKB). The SAS Quality Knowledge Base is a collection of files which store data and logic that define data quality operations
We all have challenges in getting an accurate and consistent view of our customers across multiple applications or sources of customer information. Suggestion-based matching is a technique found in SAS Data Quality to improve matching results for data that has arbitrary typos and incorrect spellings in it. The suggestion-based concept
With DataFlux Data Management 2.7, the major component of SAS Data Quality and other SAS Data Management solutions, every job has a REST API automatically created once moved to the Data Management Server. This is a great feature and enables us to easily call Data Management jobs from programming languages
In 2014, big data was on everyone’s mind. So in 2015, I expected to see data quality initiatives make a major shift toward big data. But I was surprised by a completely new requirement for data quality, which proves that the world is not all about big data – not
Bigger doesn’t always mean better. And that’s often the case with big data. Your data quality (DQ) problem – no denial, please – often only magnifies when you get bigger data sets. Having more unstructured data adds another level of complexity. The need for data quality on Hadoop is shown by user
Today’s natural language processing (NLP) systems can do some amazing things, including enabling the transformation of unstructured data into structured numerical and/or categorical data. Why is this important? Because once the key information has been identified or a key pattern modeled, the newly created, structured data can be used in
Regulatory compliance is a principal driver for data quality and data governance initiatives in many organisations right now, particularly in the banking sector. It is interesting to observe how many financial institutions immediately demand longer timeframes to help get their 'house in order' in preparation for each directive. To the
Utilizing big data analytics is currently one of the most promising strategies for businesses to gain competitive advantage and ensure future growth. But as we saw with “small data analytics,” the success of “big data analytics” relies heavily on the quality of its source data. In fact, when combining “small” and “big” data
This isn't Kansas anymore. Oz has become a sprawling, smart metropolis filled with sensor data. How do we make sense of, clean, govern and glean value from this big data so we can get Dorothy home? The answer is SAS Data Management. With the latest portfolio updates, customers will be
Loraine Lawson recently used the Eight-Fold Path of Buddhism, in which practitioners are encouraged to pursue right views, intentions, speech, actions, livelihood, efforts, mindfulness and concentration, as inspiration for her blog post The Five-Fold Path for Ensuring Data = Information. The post offered five recommendations for ensuring that data is transformed into
SAS Technical Training Consultant Mary Kathryn Queen introduces you to SAS Data Studio's Suggestions feature.
Clark Bradley explains how SAS can make Hadoop approachable and accessible.
Ivor Moan explains how SAS Data Management software can help you address GDPR requirements.
SAS Global Forum 2016のユーザープログラムでの発表論文を、”Hadoop”というキーワードで検索し、SAS on Hadoop関連の発表・論文を集めてみました。ざっと見たところ、SAS on Hadoopソリューションにまつわる全ての話題が網羅されていると感じます。 SAS Global Forum 2016 Proceedings – Hadoop 関連のSAS社員による講演・論文 SAS® and Hadoop: The 5th Annual State of the Union 9.4M3で実現しているSASとHadoopの連携について概説。2014年には、SAS Forum Japanでも登壇した、Paul Kentが語ります。 Introducing - SAS® Grid Manager for Hadoop Grid ManagerのHadoop版の話です。 Deep Dive with SAS® Studio into SAS® Grid Manager 9.4 SAS
In erster Linie wird der Begriff Datenqualität mit Kunden- und Adressinformationen in Zusammenhang gebracht. Neben der Dublettensuche und Bereinigung von Adressdatenbeständen ist die Qualität der Produktstammdaten aber ebenfalls äußert wichtig, um automatisierte Prozessabläufe zu verbessern oder beispielsweise die Trefferquote bei Suchanfragen im Onlineshop zu erhöhen.
The data lake is a great place to take a swim, but is the water clean? My colleague, Matthew Magne, compared big data to the Fire Swamp from The Princess Bride, and it can seem that foreboding. The questions we need to ask are: How was the data transformed and
Generative AI has seen drastic improvement in image, video, audio, and text generation within the last few years. Humans, on the other hand, are still catching up on determining when it’s appropriate to use Generative AI and how to review the content generated by AI before sharing it with others.
As energy systems become more distributed, digital and dynamic, utilities are increasingly turning to AI and IoT to help modernize operations, improve reliability and accelerate decarbonization. Yet according to the IDC InfoBrief, How AIoT Is Reshaping Industrial Efficiency, Security, and Decision-Making, more than half of AIoT initiatives are still stuck in
With the rapid evolution of regulatory environments, the pressure on financial institutions (FIs) to effectively detect and prevent money laundering while staying compliant with the changing pace of regulatory requirements is greater than ever. However, with the right tools and strategies, this pressure can be effectively managed. Regulatory scrutiny is
Imagine being dropped into a vast mountain range, such as the Adirondacks and being tasked with finding a specific lake. You are told that the lake is located at the lowest part of the mountain range and the only tools you are given are a compass and a method for
Recently, AOL discontinued the dial-up tone synonymous with the internet. After 34 years, we will no longer hear the mechanical screech of connecting to the World Wide Web. Nostalgia notwithstanding, this news gives me pause to contemplate what my children will see sunset in their lifetimes. Consider Google today. A
