Thursday, 25 July 2013

Apple iBook - SQL Pattern Matching on your iPad

I have put together an Apple iBook for our new SQL pattern matching feature. The book brings together the content from the recently published whitepaper, which is available via OTN, the recent series of three podcasts and a number of presentations covering pattern matching and the new MATCH_RECOGNIZE syntax. All the content you need to learn about this great new feature, bundled up in an Apple iBook that you can read anytime, anywhere on your iPad and iPad Mini. The best part is that you can watch the three recently published online podcasts on pattern matching (Part 1, Part 2 and Part 3) without the need for an internet connection because they bundled inside the iBook!

The book has 5 chapters:

Apple IBook for SQL Pattern Matching with Oracle Database 12c
  1. Overview
  2. Introduction to pattern matching
  3. SQL pattern matching with MATCH_RECOGNIZE
  4. Customer use cases
  5. Conclusion

You can download this new iBook by clicking here. This is a very large file (200MB) so, depending on your network connection, it may take some time to download.

Please note that this iBook will only work with Apple iPad and Apple iPad Mini. It requires the latest version of the iBooks app which can be downloaded from the Apple App Store, see here for more information. There are two ways to transfer this iBook on to your iPad: 

1)use iTunes to manually sync the book to your iPad - a description of how you to do this is available: here or
2) copy the URL for the iBook into your browser on your Apple iPad and download the book directly into the iBook app.

 If you need to ask: no this iBook cannot be read on Apple iPhone, Apple iPod touch, Android devices or Windows tablets. When OSX Mavericks is finally launched you will be able to read the iBook on your Apple Mac computer

Technorati Tags: , , , , , , ,

Tuesday, 23 July 2013

Oracle Database 12c Pattern Matching Podcasts - Part 3

 Following on from last week's post "Oracle Database 12c Pattern Matching Podcasts - Part 2" here is the last part of this three part series on the new SQL pattern matching feature. 

In this final podcast we review a series of uses cases and provide conceptual simplified SQL to solve these business requirements using the new SQL pattern matching functionality. These examples are taken from real-life requirements from customers in the financial services, retail, life sciences and telecommunications industries, although the scenarios are also applicable across many other industries.

PM Podcast Part 3

lick on the above image to launch the movie, if this for some reason this link does not work then copy & paste this url: http://apex.oracle.com/pls/apex/f?p=44785:24:0::NO:24:P24_CONTENT_ID,P24_PREV_PAGE:7828,2

Note - the format is .MOV which is compatible with Apple iTunes/QuickTime. You may need to install QuickTime and/or use Apple Safari browser to access the file. There is a low-resolution MPEG4 file available here if you do not have access to Apple QuickTime and/or Safari browser. For more information about Apple Quicktime go here: http://www.apple.com/quicktime/download/

For a more detailed view of this feature please refer to the Oracle Database 12c SQL documentation which is available via the OTN website.

Technorati Tags: , , , , , , ,

Tuesday, 16 July 2013

Oracle Database 12c Pattern Matching Podcasts - Part 2

Following on from last week's post "Oracle Database 12c Pattern Matching Podcasts - Part 1" here is the second part of this three part series on the new SQL pattern matching feature.

There are four basic steps for building a MATCH_RECONGIZE clause:

  1. Define the partitions/buckets and ordering needed to identify the ‘stream of events’ you are analyzing
  2. Define the pattern of events and pattern variables identifying the individual events within the pattern
  3. Define measures: source data points, pattern data points and aggregates related to a pattern
  4. Determine how the output will be generated

The following podcast provides an overview of the most important keywords within the MATCH_RECOGNIZE clause in the context of these four simple steps.  The podcast can be accessed by clicking on the image below:

PM Podcast Part 2

 

(click on the above image to launch the movie, if this for some reason this link does not work then copy & paste this url: http://apex.oracle.com/pls/apex/f?p=44785:24:0::NO:24:P24_CONTENT_ID,P24_PREV_PAGE:7825,2)

Note - the format is .MOV which is compatible with Apple iTunes/QuickTime. You may need to install QuickTime and/or use Apple Safari browser to access the file. There is a low-resolution MPEG4 file available here if you do not have access to Apple QuickTime and/or Safari browser. For more information about Apple Quicktime go here: http://www.apple.com/quicktime/download/

For a more detailed view of this feature please refer to the Oracle Database 12c SQL documentation which is available via the OTN website.

Technorati Tags: , , , , , ,

Friday, 12 July 2013

12c launch webcast - key data warehousing features explained

In case you missed Wednesday's Oracle Database 12c launch webcast then the good news is that it is now available for on-demand replay. The live session was amazingly well attended and the questions posted by the participants were great. There were quite a few data warehousing questions posted and I think I managed to answer nearly all of them. If I missed your particular question then let me know and I will make sure you get an answer.  

During the webcast Tom Kyte offered his "Top 12 features of Oracle Database 12c" and there were quite a few data warehousing features that made it on to his list:

  • SQL analytics row_limiting/Top-n
  • Pattern matching
  • Partitioning enhancements
  • Adaptive execution plans 
You can watch the webcast right now by clicking on the image below, which will take you to the landing pad for the on-demand replay. 

alternatively you can click here to watch the webcast. FYI - there is a registration process but it is quite painless.

Once you watched the webcast I expect you will want to get more information about each of these features so below I have provided a brief overview of each feature and a link to the feature whitepaper:

Adaptive Query Optimization - The new groundbreaking adaptive query optimization in Oracle Database 12c enables the Optimizer to make runtime adjustments to execution plans and to discover additional information that can lead to better statistics. Learn about this exciting new functionality here. The home page on OTN is here.

SQL Pattern Matching - The new groundbreaking SQL pattern matching capabilities brings the simplicity and efficiency of the most common data analysis language to the process of identifying patterns within a data set. It provides a completely new native SQL syntax that has adopted the regular expression capabilities of Perl by implementing a core set of rules to define patterns in sequences (streams of rows). Learn about this exciting new functionality here. The home page on OTN is here.

Partitioning - Oracle has enhanced the functionality of Oracle Partitioning with every release, by either adding new partitioning techniques, enhancing the scalability, or extending the manageability and maintenance capabilities. Oracle Database 12c is no different by offering enhanced composite partitioning strategies and vastly enhanced partition maintenance operations.  Learn about this exciting new functionality here. The home page on OTN is here.

Heat Map- stores system-generated data usage statistics at the row and segment levels – information that can be used to automate the compression and movement of data in order to reduce storage costs, improve performance and optimize Oracle Database storage. Heat Map, used in conjunction with Automatic Data Optimization can automate compression and storage policies based on the usage of the data. Learn about this exciting new functionality here. The home page on OTN is here.

Hope the above is useful.

Technorati Tags: , , , , ,

Wednesday, 10 July 2013

Oracle Database 12c Pattern Matching Podcasts - Part 1

In my post last week, linked to the release of Oracle Database 12c, I outlined the new SQL Pattern Matching feature. If you have visited the Database home page on OTN you will noticed that this particular feature is called out in the section "Major New Oracle Database 12c Features and Products" so this is really quite a big deal! 

To help you explore and understand this feature I have recorded a series of three podcasts:

  • Part 1 - Provides an introduction to pattern matching
  • Part 2 - Reviews basic concepts, syntax and demonstration
  • Part 3 - Documents a series of real world uses cases

Over the next three weeks I will be posting links to these podcasts. The first podcast is now available and can be accessed by clicking on the image below:

Podcast Part 1 00084

(click on the above image to launch the movie, if this for some reason this link does not work then copy & paste this url: http://apex.oracle.com/pls/apex/f?p=44785:24:0::NO:24:P24_CONTENT_ID,P24_PREV_PAGE:7827,2)

Note - the format is .MOV which is compatible with Apple iTunes/QuickTime. You may need to install QuickTime and/or use Apple Safari browser to access the file. There is a low-resolution MPEG4 file available here if you do not have access to Apple QuickTime and/or Safari browser. For more information about Apple Quicktime go here: http://www.apple.com/quicktime/download/

This first podcast is quite brief. It covers three key topics:

  • Why pattern matching is important
  • Looked at a real world example relating to the use of mobile phones
  • Reviewed a simple example of the new 12c MATCH_RECOGNIZE clause

Over the next couple of weeks I will post part-two (which contains a review of the basic concepts, syntax and demonstration) followed by part-three (a look at a series of real world uses case). Once all the podcasts have been posted I will provide a link to a multi-media iBook (requires an Apple iPad) which contains embedded presentations along with these three podcasts. 

 

Technorati Tags: , , , , , ,

Wednesday, 3 July 2013

OpenWorld 2103 - My two sessions on SQL analytics

OOW Banner

Good news, I will be presenting two papers at this year's OOW.

The first session is a customer panel: Your Data Is Talking to You: Customers Describe How In-Database Analytics Drives Their Business

Your data is talking to you, but do you have the analytics to listen? The business world today is filled with immense opportunities for translating the messages from our data into insights and actions. In this session, a panel showcases several customers that have taken listening to their data to completely new levels. Come hear how you can better use the database you have today to improve productivity, cut costs, and increase customer satisfaction with in-database analytics.

This will be a great session because you will have the chance to talk to customers who are really pushing the boundaries of SQL analytics. If you are using SQL to drive your DW and BI solutions then come and share your ideas and use cases because this panel will definitely be a two-way communication session. Everyone is going to learn something new and amazing during this session. Here is a link to the entry in the content catalog so you can add this session to your online agenda, click here.

Session number two is a presentation that is linked to the topic above: SQL: The Best Development Language for Big Data

Large-scale data processing is undergoing tremendous transformations: new datasources are more readily available, and businesses are focusing more heavily on analytic solutions. Hadoop and other nonrelational datasources are becoming more common, but working with and analyzing this data is hard. SQL, on the other hand, is the most commonly used language for data analysis. So how can we combine these two? This session discusses Oracle’s analytical SQL capabilities and how complex analytical queries running on large to extremely large data sets are becoming a reality, even on datasources outside the relational world. Learn also how Oracle envisions the future of a unified analytical world.

This should be a lively and interactive session and I will be looking to the audience to really engage with this content as SQL analytics and big data are both hot topics. Here is a link to the entry in the content catalog so you can add this session to your online agenda, click here.

If you are going to be at OpenWorld I would love to meet up with you to talk about SQL analytics, use cases, ideas, enhancement requests etc. Looking forward to seeing you at this year's event - it is going to be a good one!

 

Technorati Tags: , , , , ,

Tuesday, 2 July 2013

Fighting crime using statistics

There is an interesting article in today's online edition of the Guardian newspaper (http://www.guardian.co.uk/science/2013/jul/01/how-algorithms-rule-world-nsa) about the use of statistics by police departments around the world. There is even a new term to describe this "new" approach to policing - Crush. It stands for "Criminal Reduction Utilising Statistical History" which means police forces are predictive analytics to help them fight crime.

When you think about this (bearing in mind the recent revelations about the data collection and analysis operations of the US government) all law enforcement agencies are required to consider how, when and where to deploy their resources to ensure maximum "efficiency". While the report in the Guardian focuses on the police department in Memphis, Tennessee it does mention in passing that two UK police forces who are also using Crush. I would like to add another example of this sophisticated approach to crime fighting. 

The Italian Department of Public Security of the Ministry of the Interior  has, for some time, been using Oracle Spatial and Oracle’s data mining features to help track crime, understand how crime patterns change over time and determine the most efficient way to use their resources.

The agency created an advanced data warehouse containing detailed information about criminal events. Each record covered all the aspects of each crime by including data points such as details about the victim, location information, date, time, type of crime etc. These data points allowed crime teams to evaluate existing criminal activities and patterns to help predict future criminal activities in terms of type of crime and crucially the likely location. Oracle’s in-database analytics and support for a wide variety of data types were used to deliver efficient management, integration and analysis of all the different types data recorded in the crime reports.

Oracle’s in-database Spatial and Advanced Analytics were used to enrich the basic data that was collected to generate both geospatial data points and additional statistical data points to help evaluate the relevance and confidence of the predictions.

The agency used an Oracle’s Business Intelligence tools to provide cartographic views of the geospatial information alongside the standard reporting views (tabular and graphical), which helped the crime teams get a more complete picture of the various patterns of crimes across their regions. The enriched data warehouse was able to support three levels of analysis relating to geospatial analysis, classification and grouping of types of crime and a real-time research feature.

Already today, a large number of crime teams are leveraging this new system and it has significantly increased their ability to analyze criminal activity and has reduced the time taken to respond to queries. The data warehouse is being further extended to track the progress of reported crimes with the objective being to incorporate this additional information in to the predictive model that helps plan how law enforcement resources are deployed.

This new data warehouse has helped this agency to produce predictive and proactive analysis of criminal activity. It has helped them manage their resources more effectively by increasing patrols in higher risk locations and placing offices directly in critical areas. In the future the system will allow teams to analyze specific dangerous patterns of activity using typical characteristics of a crime such as the time slot, location and the specific geospatial features of the area such as the proximity of points of interest.

If you want more information about the scenario outlined above then read this customer press release from last November (2012): http://www.oracle.com/us/corporate/press/1871463.

PDF Image 04 copy

There is a very good technical presentation from Iconsulting (an excellent Oracle partner that has a huge amount of experience with our spatial and data mining features) available here (http://download.oracle.com/otndocs/products/spatial/pdf/osuc2011_presentations/osuc2011_licrime_mantovani.pdf) that explains how they implemented the crime dashboard for the Department of Public Security of the Ministry of the Interior.

This is a great example of Oracle's unique analytical capabilities: in-database analytical mashups. The layering of spatial analytics over data mining discoveries and then using the analytical capabilities of each feature to drive further, deeper analysis is a core strength of our database. "Take the analysis to the data" and you can open up a whole new world of discoveries. 

 

Technorati Tags: , , , , , ,