Big data in motion
JacquesRoy 120000A2MS 1,614 Views
Once again, another full day. There were Informix sessions on embeddability, virtualization/cloud computing, security, and zero-downtime upgrade. We also heard a great presentation on database tuning from Rick Rabe and Tom Girsch from Hilton Hotels.
Great sessions altogether. Now on to Thursday.
JacquesRoy 120000A2MS 1,605 Views
Since I've been on a common driver kick lately, might as well keep on going...
There was a chat with the lab on Feb 25th that talked about the common Java JDBC driver (referred as the JCC driver): Top 10 reasons to consider IBM Data Server Driver for JDBC and SQLJ for IDS servers.
You can use the JCC driver with IDS when connecting using the DRDA protocol. Some of the benefits include:
All this is significant:
For more information on this chat with the lab:
Here's Where you can find information on this chat with the lab:
JacquesRoy 120000A2MS 1,600 Views
I am currently in Belgium, Brussels with Terri Gerber. Last Tuesday, we had a successful meeting with an Informix customer. After the meeting, in late afternoon, Patrick Billens took us around to show us the sites of Brussels including among other things the royal palace and the "grande place". Little did I know that soon, Terri would almost cause an international incident with the digital equipment she was carrying.
It happened soon after we saw the king's working palace. The flag at the top of the palace indicated that the king was currently there working. We turned the corner after the palace and Patrick pointed to another building with an American Flag in front of it. Terri took out her digital camera and quickly took a picture. Within seconds, two Belgium police officer were in hot pursuit and quickly caught up with us. Before all h**l broke loose, Patrick intervened, avoiding the worse. I could only imagine what could have happened: Two officers tackling the red-jacket wearing culprit followed by a struggle to get to the digital camera.
Terri did not surrender her camera. Instead, she wrestled with its ease of use and deleted the offending picture in front of the officers. Satisfied with the action taken, we were free to go on our way.
At this time, Terri is on her way back home to Massachusett. Is the picture really deleted? I'm sure it would be possible to un-delete it. Hopefully this won't be a concern for the department of homeland security. If that becomes an issue, I'm sure Terri would be willing to share information with homeland security on how much Informix could help them make the country safer.
JacquesRoy 120000A2MS 1,596 Views
Last Wednesday, Terri and I went from Brussels to Roosendaal (Netherland) to visit our Informix partner Informa. The first thing we saw when we arrived at their building was a 4 feet tall informix logo sign, the original blue logo.
We had a great meeting talking about the Informix roadmap and the state of the Informix business as they see it at Informa. Bertino and Rob also told us that they found two Informix customers that did not know that IBM had bought Informix!
We were back in Brussels between 5:30 and 6:00 in the evening and went out for dinner. When it came to pay, it turned out we could not use our credit cards since our cards do not include a chip. Here, in Europe, they all use smart cards.
That reminds me of the Informix conference in Chicago back, I believe, in 1997. At that conference, attendees would get a smartcard that was used for multiple purposes. One of them was that they could go to a PC, insert their card in the reader and take a conference survey. After the survey was submitted, they could go claim a T-shirt as a thank you prize. Before they could get the T-shirt, The smart card would be checked to make sure the attendee completed the survey and then mark their card with the fact that they had received their T-shirt. As it happens, I wrote the application that took care of the survey.
The survey was done through a web browser running on a windows machine (16-bit windows at the time). A smart card reader was attached to the PC. The attendee would insert their smartcard in the reader and invoke the survey URL. This request would execute a program on the server that would call back the PC using the PC internat address and a pre-defined port number to read the smart card and fill out the basic information on the form such as name and address. Once the survey was submitted, the application would again access the smartcard to turn on the indicator that said that the survey had been completed.
I'm sure that the capacity of smart cards has greatly increased over the last 10 years or so. A lot could be stored on those. We could store a biometric key as password (fingerprint) and all sort of personal information such as medical records and medical activities, including prescriptions. With this always up-to-date record, it could reduce risks of errors, drug abuse, and so on. The update could be done to the smartcard at the point of service and also sent to a national database through, let say, web services.
IDS can handle millions of transactions per second. It has a proven track record of reliability and scalability and is used to stringent response time requirements. Fro example, IDS is able to handle the employee badge of IBM employees worldwide to give them access to different areas of IBM. IDS also handles large streams of financial information and makes them available for analysis almost instanteneously. Handling the medical record updates would be no problem since we can easily scale out through the distribution of the data over multiple machines either through the continuous availability feature (shared disks). In the medical record case, I would likely look at Enterprise Replication (ER) as my first enabling feature.
All that to say that smart card may be worth another look. The use of smart card with IDS could open the door to many new capabilities in all sort of emerging market and new application.
JacquesRoy 120000A2MS 1,568 Views
At the IOD conference last October, I ran into Rafael Coss (IBM, Data Studio) and Vladimir Bacvanski (InferData) in the expo center. Both started raving about a language named Groovy. That got my attention.
To learn more about Groovy, they suggested the book:
Groovy in Action
Miraculously, Santa brought me that book for Christmas :-)
Groovy is a relatively new scripting language that is part of the Java family: Groovy scripts are converted into Java byte code. This makes it 100% compatible with Java. It is the equivalent of using an additional jar file as part of a Java program.
The implication is that we can use the Informix JDBC driver or the IBM Data Server JCC driver to access IDS from Groovy.
Why a new scripting language? Java is a powerful language but some constructs are difficult to build. By providing a compatible scripting language, Java can now easily go over these hurdles, making it compatible with other scripting language. More notably Ruby with the Rails framework. Groovy also has a companion framework called Grails: Groovy Rails.
Groovy may have a slight advantage because it can be compiled into byte code. This should make it faster than scripting languages.
More on Groovy next time.[Read More]
JacquesRoy 120000A2MS 1,567 Views
I just finished the first day of class at the university of Strasbourg. Almost everything went well.
There are 20 students in the class in addition to Pierre Tellier. The class could accommodate 26 people so a total of 21 makes it look quite full. We started the day with an introduction presentation that includes, among other things, the class objectives, an agenda with tentative timing, some background on databases, and a description of the lab environment. Thiswas followed by a presentation discussion consideration on performance as it relates to hardware, operating systems, and databases. In the afternoon, we went through an introduction to IDS which led to our first lab.
After spending an hour telling them how great IDS is and how easy it is to use, the first thing I saw in the lab was that IDS would not come up! It turns out I hardcoded an IP address for the host address that worked fine on my laptop but when executed on the lab machines, the address was wrong. After struggling through finding the character positions on a French keyboard (think '|', '/', '$', etc.) I figured out the problem, provided the solution to the class and the lab continued without problems. I made sure to explain that the problem was a network address, not IDS!
We finished the day with a partial presentation on database extensibility that will continue Tuesday morning.
the students seemed to enjoy the content and the delivery of the presentations and Pierre was happy with it. I'd say that the first day was a success, two days to go. Let's see what happens...[Read More]
JacquesRoy 120000A2MS 1,561 Views
Do you know about IBM Data Magazine? It is the regular newsletter based on ibmdatamag.com that many people receive in their inbox
This online magazine contains articles related to: Big Data and Warehousing, Databases, Information Strategy, Integration and governance.
My first article got published on January 31st and is titled: "Getting the big data ball rolling".
I have put together a plan for a series of articles. When it gets more in depth, I will complement the articles with
Until next time...
JacquesRoy 120000A2MS 1,553 Views
I have to say, these are busy times!
With TimeSeries PoC and multiple activities around Streams, time flies by quickly.
It's been a while since I updated the InfoSphere Streams Playbook. This was overdue. There are new videos, training material and capabilities that were not reflected in the playbook. Here's what I updated:
With the end of the year so close, we can expect everyone to prepare for the new year. Looks like 2014 will be another fun year!
JacquesRoy 120000A2MS 1,551 Views
What does Groovy have to do with Informix?
For one, we can develop applications in Groovy accessing IDS since it can use the JDBC driver (or the common data server JCC driver).
Second, the Groovy community has put together an eclipse plug-in that allows you to edit, compile, and run groovy scripts and classes. According to their web site (http://groovy.codehaus.org/Eclipse+Plugin), it works with Eclipse 3.3 and 3.4 but not with 3.2.
For what I can tell, the latest version of IBM Data Studio Developer (version 2.1) is based on Eclipse 3.4.1 so it should work fine.
Third, we should be able to use Groovy to write user-defined routines. I admit, I did not try it but if you compile the Groovy code and make the Jar file that implements Groovy available either as part of the UDR or in the onconfig classpath, it should work fine.
If you want to start playing with Groovy, take a look at the following site:
Let me know how it goes...
JacquesRoy 120000A2MS 1,544 Views
Just a quick note to say that I'll resume blogging soon.
Great things are hppening with Informix. Stay tuned!
JacquesRoy 120000A2MS 1,533 Views
Please see the following story Trafficmaster and IBM Develop Solution for Smarter Driving to learn more about how Informix makes life easier for drivers in the UK. Here's a quote form the article:
"Trafficmaster is able to provide drivers with real-time route planning and more accurate estimated arrival times than ever before with the help of the IBM Informix data base technology," said Stuart Berman, Executive Director, Trafficmaster.
JacquesRoy 120000A2MS 1,507 Views
I was reading recently that scripting languages are becoming more and more popular. One of the benefits listed was that it can increase productivity significantly. That brings me back a long time when I used to argue that you could write a solution in APL so much faster than any of the traditional languages...
PHP is a popular scripting language that is used to create web solutions. Here are some information if you want or need to use it with IDS.
To use IDS with PHP, you need to add the PDO_INFORMIX interface to it. tis interface can be found in PECL:http://pecl.php.net/package/PDO_INFORMIX
The current version is 1.2.0 and came out in March 2008. You will to use the appropriate Informix CSDK to compile it for your platform.
Note that there is another PHP driver available for IDS 11: PDO_IBM. It is available from IBM in the IBM Data Server Client as a pre-built component. See:https://www14.software.ibm.com/webapp/iwm/web/reg/pick.do?lang=en_US&source=swg-idsc11
If you want to get going quickly, you can find Apache-PHP-PDO_INFORMIX ready to go with the Open Admin Tool for IDS (OAT). This product is available for IDS 11. You can find it at:https://www14.software.ibm.com/webapp/iwm/web/reg/download.do?lang=en_US&cp=UTF-8&S_PKG=dl&source=swg-informixfpd
You can also use the package from Zend: Zend Core for IBM at:http://www.zend.com/en/products/core/for-ibm
If you want to build the environment yourself, here are two articles that can help you figure out the process:
With this information, you should be able to get started quickly[Read More]
JacquesRoy 120000A2MS 1,504 Views
There is now a new resource for Streams: https://www.ibmdw.net/streamsdev/
The Streamsdev site includes articles, blog entries, videos, and intro labs. You can also get to the download the latest quickstart edition of Streams from there. This way, you can download either the product or a vmware image with it and do the lab at your leisure.
This site is put together by developers for developers. Still, if you are new to InfoSphere Streams, you can find something there for you too. Just go to the getting started section under "Docs".
Since the IBM Information on Demand (IOD) conference starts this weekend, you can also find information on the activities (labs, presentation) on Streams during the conference. You can see the next few acticities on the mainpage or a more complete calendar under events.
This site is evolving. You should go look at it at least once a week to see what's new.
Hopefully many of you are going to the IOD conference next week. Enjoy the conference and learn a lot!
JacquesRoy 120000A2MS 1,483 Views
Another year, another conference. It has been so busy that I have not had the time to write a short blog entry for each day. Here is my quick update.< /p>
It all started Saturday morning with the business partner council and the customer advisory council on Saturday. I attended the customer advisory council and I found it interesting and full of good discussions.
The conference was kicked off with an opening reception on Sunday night and we were off to the race. There were eight Informix sessions on Monday including presentations on how IBM helps Cisco, open source, hands on lab on high-availability, another one on the new features of Informix 11.70, bests practices for virtual environments, and performance enhancements. Of course, the most popular session was from Jerry Keesee titled: "Informix at IBM: The next decade".
The day ended with an Informix reception at the Mandalay Bay beach casino for an Informix 11.70 launch celebration and to start looking forward to the next decade of Informix at IBM.
Tuesday started early with an Informix "eat and meet" breakfast at 7:00am, followed by nine Informix sessions throughout the day. The sessions covered areas such as upgrade, new features, Informix warehouse, application development, 4GL, embeddability, flexible grid, and more. It was also interesting to hear about how Informix is used to run a steel plant.
The day ended with a beach party reception. Now it is on the Wednesday with another full agenda.
JacquesRoy 120000A2MS 1,482 Views
Continuing from the last entry...
Out of these 197,000 entries, here are some more that may be of interest:
I'm sure we can find a lot more of interesting sites. There is a lot about IDS on the web[Read More]
JacquesRoy 120000A2MS 1,476 Views
When I was in France, I met two partners/resellers: VMark and Frame. Both partners are strong Informix partners and supporters. It is always good to meet partners of this caliber.
In addition to them, I must give a particular mention for ConsultiX's Khaled Bentebal that went the extra mile and re-started the France's Informix users' group with a meeting on September 30th. The meeting was well attended with over 20 people despite some scheduling issues that greatly reduced the advertising for it. There was a mix of roadmap, positioning and technical presentations that were enthusiastically received by the audience.
This year we have seen several countries starting Informix users groups. the one in France is the latest that shows that Informix is growing and doing well. I wish Khaled and the France Informix users' group all the best.
JacquesRoy 120000A2MS 1,465 Views
If you've been following my blog over the last few years, you can notice a few things lately:
The significant part is really the name change. It went from "Informix and Computing" to "Big data in motion".
Let me first address the Informix part. Yes, I am still involved with Informix activities. In fact, I am currently working on a proof-of-concept for Informix TimeSeries that involves technologies such as Java, kafka, zookeeper, fastjson, messagePack, and more. So, Informix continues to be involved in "Big Data" and its use with other current technologies.
Will I continue to talk about Informix? Probably. It all depends if I believe I have something interesting to say on the subject. As long as I have activities with Informix I have opportunities to find interesting information.
Now. What about "Big data in motion"?
A while back I decided to go back to my old team: Worldwide Technical Sales and Enablement.
My main focus is now on InfoSphere Streams. This has already been an interesting ride. I've worked on multiple projects that include putting together an extensive training session, work on PoCs, writing DeveloperWorks articles, and more. I've even put together a DeveloperWorks wiki that centralizes all sort of resources related to InfoSphere Streams. I called it the InfoSphere Streams Playbook.
InfoSphere Streams is part of an overall "Big Data" architecture. There are many ties between Streams and the BigInsights platform and any other technologies that help getting big data under control. Yes, that includes Informix. It also includes many other technologies.
My focus may be mainly on "in-motion" data but the entire "Big Data" solution stack eventually interacts with it. That explains the new blog title.
As usual, I want to continue "casting a large net" so I can be free to talk about anything I find interesting.
So, drop me line, post comments. Let's continue a dialog that will help everyone (including me) learn new things and continue to have fun with our technological challenges.
JacquesRoy 120000A2MS 1,463 Views
The day started with a keynote speach by Jerry Keesee. I believe the key to the presentation is that the Informix is taking the next step to insure continuing growth of the Informix product. There are some exciting things happening on that front.
The first session I attended was "Data Modeling" given by Jack Parker. There were a lot of interesting examples how a data model greatly impact your production system. I have to agree with Jack that the greatest performance gain in with the data model, not tunig the database after the fact. This is why database experts should be involved at the beginining of a project. They can then also take advantage of database extensibility; something I could talk about for a long time...
There were five sessions going at once for a total of 30 sessions for Monday. There were a lot of good sessions on subjects including database administration, application development, programming, security and more. there wer demos of all sort and great conversations to be had. Someone told me that one of the benefits of this conference is that they can solve in minutes problems that have benn bugging them for weeks.
Of course the evening event was also worth attending with a bunch of engineers coming from the lab just to talk to everyone. All in all a fantastic day!
JacquesRoy 120000A2MS 1,450 Views
The IOD conference is less than a week away. I received an email about a blog entry that lists all the book signings that will happen at IOD. A total of 10. I happen to be one of them.
I wrote a short book titled: "Informix Dynamic Server Application Development - Getting Started". It is a free book that will be available at the conference. My book signing session is as follows:
Tuesday 12:00 pm - 1:00 pm
Location: Mandalay Bay Registration Desk South
Since I'm giving up my lunch for this, please stop by and say hi. For more information on all the book signings at IOD, please see the following blog entry:
(Short URL: http://bit.ly/KB8zy)
JacquesRoy 120000A2MS 1,449 Views
I remember seeing something like this title in some Informix marketing material many years ago. I think it was related to the fact that IDS has extensibility features that allow developers to adapt IDS to their business requirements as the technology and needs evolve.
The "future built-in" idea came back to me as I was reading a computerworld article titled: "the desktop traffic jam" (see: http://www.computerworld.com/s/article/342870/The_Desktop_Traffic_Jam). In there they were talking about a new feature in Windows 7 (User Mode Scheduling) that lets thread multiplexing take place in the application instead of in the kernel. They go on to say: "Handling this multiplexing in the application instead of in the operating system kernel makes thread scheduling more efficient.
I know it's not quite the same but it is similar to the idea that IDS decides its thread scheduling, making it more efficient since it is will not re-schedule a thread that is in a critical section of code. This way it avoids having threads that get scheduled to find out that they have to wait. All that making the threading model more efficient. I wonder how difficult it would be to take advantage of thread multiplexing onto cores. Could it be as simple as having one CPU VP per core wih some "core affinity" of the operating system supports that? Then IDS would already be there... with the future built into it.