Java One 2017: Open Source Big Data in the Cloud (Hadoop, Hive, Spark, Kafka)

It’s true. I always said “presenting at Java One is like playing in champions league”. Last month I had the great pleasure to present at the Java One 2017 conference in San Francisco together with Edelweiss Kammermann about Open Source Big Data used in the cloud. The presentation included 4 live demos about Apache Hadoop with Map Reduce, Apache Hive, Apache Spark and Kafka all using Oracle Big Data Cloud Service – Compute Edition (aka BDCS-CE) and the Oracle Event Hub Service. The presentation was recorded – so you can enjoy from anywhere in the world.

For your convenience the slides are available on slideshare:

Oracle Big Data Compute Service: Unable to create service

When creating a new instance of the Oracle Big Data Compute Service I faced the following error message:

Unable to create service, please check log file to get the real cause.

So far the reason is unknown. The same request was working using another account (provisioned in Europe, not in the US), so I assume it is somehow related to the account settings.

I escalated this issue to Oracle and they are working on it. Once there will be more news of course I will post the solution here.

When implementing a PaaS service you should make make sure:

  • to provide meaningful error messages. Tell the user WHY something is not working.
  • make sure people if your PaaS really provides a log file and how to access it

Storage Container Name: Conflicting Syntax for Storage Container Names in Oracle Big Data Service Compute Edition

I already presented and published how to get Oracle Java Cloud Service to work, but it seems that a little help for Big Data Service Compute Edition can be useful as well.

One showstopper is the Storage Container Name. If you check the documentation it says you have to provide the REST URL:

Storage Container Syntax (Big Data Cloud Service Compute Edition)

On the cloud console however it says that you should use the Syntax that is known from JCS or DB as a Service:

Name of an Oracle Storage Cloud Service container of the form Storage-IDDomain/yourChoiceOfContainerName. e.g: storagesvc999-usoracleaccoutrial00999 /backupContainer; If not already created, you must create the container following the Oracle Cloud Storage documentation.

In this case the documentation is wrong. The following format is correct:

Storage-IDDomain/yourChoiceOfContainerName