This week, I was reminded that back in 2011, Watson beat two human players, Ken Jennings and Brad Rutter on the TV game show "Jeopardy!" On his last response, Ken wrote "I for one welcome our new computer overlords." With IBM investing heavily in Cognitive Solutions, should people be worried, or welcome the new technology?
Back in 1950, Isaac Asimov proposed "Three laws of robots":
- A robot may not injure a human being or, through inaction, allow a human being to come to harm.
- A robot must obey orders given it by human beings except where such orders would conflict with the First Law.
- A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
Let's take a look at how Artificial Intelligence has been represented in the movies over the past few decades. I have put these in chronological order when they were initially released in the United States.
(FCC Disclosure and Spoiler Alert: I work for IBM. This blog post can be considered a "paid celebrity endorsement" for cognitive solutions made by IBM. While IBM may have been involved or featured in some of these movies, I have no financial interest in them. I have seen them all and highly recommend them. I am hoping that you have all seen these, or at least familiar enough with their plot lines that I am not spoiling them for you.)
- 2001: A Space Odyssey
Back in 1968, Stanley Kubrick and Arthur C. Clarke made a masterpiece movie about a mysterious obelisk floating near Jupiter. To investigate, a crew of human beings takes a space ship managed by a sentient computer named [HAL-9000].
(Many people thought HAL was a subtle reference to IBM. Stanley Kubrick clarifies:
"By the way, just to show you how interpretation can sometimes be bewildering: A cryptographer went to see the film, and he said, 'Oh. I get it. Each letter of HAL's name is one letter ahead of IBM. The H is one letter in front of I, the A is one letter in front of B, and the L is one letter in front of M.'
Now this is a pure coincidence, because HAL's name is an acronym of heuristic and algorithmic, the two methods of computer programming...an almost inconceivable coincidence. It would have taken a cryptographer to have noticed that."
Source: The Making of 2001: A Space Odyssey, Eye Magazine Interview, Modern Library, pp. 249)
The problem arises when HAL-9000 refuses commands from the astronauts. The astronauts are not in control, HAL-9000 was given separate orders from ground control back on earth, and it has determined it would be more successful without the crew.
In 1973, Michael Crichton wrote and directed this movie about an amusement park with three uniquely themed areas: Medieval World, Roman World, and Westworld. Robots are used to staff the parks to make them more realistic, interacting with the guests in character appropriate for each time period.
A malfunction spreads like a computer virus among the robots, causing them to harm or kill the park's guests. Yul Brenner played a robot called simply "the Gunslinger". Equipped with fast reflexes and infrared vision, the Gunslinger proves especially deadly!
(Michael Crichton also wrote "Jurassic Park", which had a similar story line involving dinosaurs with catastrophic results!)
Last year, HBO launched a TV series called "Westworld", based on the same themes covered in this movie. The first season of 10 episodes just finished, and the next season is scheduled for 2018.
- Blade Runner
Directed by Ridley Scott, this 1982 movie stars Harrison Ford as Rick Deckard, a law enforcement officer. Rick is tasked to hunt down and "retire" four cognitive androids named "replicants" that have killed some humans and are now in search of their creator, a man named J. F. Sebastian.
(I enjoy the euphemisms used in these movies. Terms like kill, murder or assassinate apply to humans but not machines. The word "retire" in this movie refers to destruction of the robots. As we say in IBM, "retirement is not something you do, it is something done to you!")
Destroying machines does not carry the same emotional toll as killing humans, but this movie explores that empathy. A sequel called "Blade Runner 2049" will be released later this year.
In 1983, Matthew Broderick plays David, a young high school student who hacks into the U.S. Military's War Operation Plan Response (WOPR) computer. The WOPR was designed to run various strategic games, including war game simulations, learning as it goes. David decides to initiate the game "Global Thermonuclear War", and the military responds as if the threats were real.
Can the computer learn that the only way to win a war is not to wage it in the first place? And if a computer can learn this, can our human leaders learn this too?
In this series of movies, a franchise spanning from 1984 to 2009, the US Military builds a defense grid computer called [Skynet]. After cognitive learning at an alarming rate, Skynet becomes self-aware, and decides to launch missiles, starting a nuclear war that kills over 3 billion people.
Arnold Schwarzenegger plays the Terminator model T-800, a cognitive solution in human form designed by Skynet to finish the job and kill the remainder of humanity.
- I, Robot
In this 2004 movie, Will Smith plays Del Spooner, a technophobic cop who investigates a crime committed by a cognitive robot.
(Many people associate the title with author Isaac Asimov. A short story called "I, Robot" written by Earl and Otto Binder was published in the January 1939 issue of 'Amazing Stories', well before the unrelated and more well-known book 'I, Robot' (1950), a collection of short stories, by Asimov.
Asimov admitted to being heavily influenced by the Binder short story. The title of Asimov's collection was changed to "I, Robot" by the publisher, against Asimov's wishes. Source: IMDB)
Del Spooner uncovers a bigger threat to humanity, not just a single malfunctioning robot, but rather the Virtual Interactive Kinesthetic Interface, or simply VIKI for short, a cognitive solution that controls all robots. VIKI interprets Asimov's three laws in a manner not originally intended.
- Ex Machina
In this 2015 movie, Domhnall Gleeson plays Caleb, a 26 year old programmer at the world's largest internet company. Caleb wins a competition to spend a week at a private mountain retreat. However, when Caleb arrives he discovers that he must interact with Ava, the world's first true artificial intelligence, a beautiful robot played by Alicia Vikander.
(The title derives from the Latin phrase "Deus Ex-Machina," meaning "a god from the Machine," a phrase that originated in Greek tragedies. Sources: IMDB)
Nathan, the reclusive CEO of this company, relishes this opportunity to have Caleb participate in this experiment, explaining how Artificial Intelligence (AI) will transform the world.
(The three main characters all have appropriate biblical names. Ava is a form of Eve, the first woman; Nathan was a prophet in the court of David; and Caleb was a spy sent by Moses to evaluate the Promised Land. Source: IMDB)
The premise is based in part on the famous [Turing Test], developed by Alan Turing. This is designed to test a machine's ability to exhibit intelligent behavior equivalent to, or indistinguishable from, that of a human.
Movies that depict the bad guys as a particular nationality, ethnicity or religion may be offensive to some movie audiences. Instead, having dinosaurs, monsters, aliens or robots provides a villain that all people can fear equally. This helps movie makers reach a more global audience!
Of course, if robots, androids and other forms of Artificial Intelligence did exactly what humans expect them to, we would not have the tense, thrilling action movies to watch on the big screen.
This is not a complete list of movies. Enter in the comments below your favorite movie that features Artificial Intelligence and why it is your favorite!
technorati tags: IBM, Watson, Jeopardy, Ken Jennings, Brad Rutter, computer overlords, cognitive solutions, Isaac Asimov, three laws of robots, Artificial Intelligence, Stanley Kubrick, Arthur C. Clarke, HAL 9000, Space Odyssey, Westworld, Michael Crichton, Yul Brenner, Jurassic Park, HBO, Blade Runner, Ridley Scott, Harrison Ford, WarGames, Matthew Broderick, WOPR, Terminator, Skynet, Arnold Schwarzenegger, I, Robot, Will Smith, VIKI, Ex Machina, Domhnall Gleeson, Alicia Vikander, Turing Test, Alan Turing
Last week, fellow IBM blogger Barry Whyte Barry pointed out that my recent post on [Cognitive University for Watson Systems SmartSeller] was my 1,000th blog post. After 10 years of blogging, I have reached the 1,000 mark!
(As IBM is focused on its transformation from a "Systems, Software and Services" company to a "Cognitive Solutions and Cloud Platform" company, it seems appropriate to highlight my 1,000 blog post on the concept of cognitive solutions.)
A lot of people ask me to explain what exactly does IBM mean by "cognitive", which is a fair question. Let's start with the [Dictionary definition]:
- of or relating to cognition; concerned with the act or process of knowing, perceiving, etc.
- of or relating to the mental processes of perception, memory, judgment, and reasoning, as contrasted with emotional and volitional processes.
What exactly does IBM mean by Cognitive? IBM has taken this definition, and focused on four key strategic areas:
In the summer of 1981, I spent a summer debugging a "Pascal" compiler at the University of Texas at Austin. I wasn't told that was what I was doing. Rather, I was tasked with writing sample Pascal programs that would demonstrate the features and capabilities of the language.
Every day, I would come up with a concept of a program, punch up the cards, run it through the CDC hopper, and verify that it would work properly. If I didn't have it working by lunch, I would take it to the "help desk", they would look it over, and tell me how to fix it after I got back.
Most of the time, it was a mistake in my software. A few times, however, it was a flaw in the compiler itself. My programs were basically test cases, and the Pascal Compiler development team was fixing or enhancing the compiler code every time I had a problem.
Compilers basically work by parsing the program text, looking for fixed keywords that are entered in a specifically prescribed order to make sense. Other keywords may represent data types, variables, constants or pre-defined macros.
But compilers are not cognitive. Cognitive solutions can understand natural language, and have to handle all the ambiguity of words not being in the correct order, or different words having different meanings.
As an Electrical Engineer, I had to take many classes on classical analog signal processing. In fact, all computers have some amount of analog components, where threshold processing is used to differentiate a zero (0) from a one (1).
For example, if a "zero" value was represented by 1 volt, and a "one" value by 5 volts, then you can set a threshold at 3 volts. Any voltage less than 3 would be considered a "zero" value, and anything 3 volts or greater a "one" value.
But threshold processing is not cognitive. Cognitive solutions also use thresholds, but their thresholds are dynamically determined, through advanced analytics and statistical mathematical models, and may adjust up and down as needed, based on machine learning over time.
IBM Research is proud to have developed the world's most advanced caching algorithms for its storage systems. Cache memory is very fast, but also very expensive, so offered in limited quantities. Caching algorithms decide which blocks of data should remain in cache, and which should be kicked out.
Ideally, a block in read cache would be kicked out precisely after the last time it was read, with little or no expectation for being read again anytime soon. Likewise, a block in write cache would be destaged to persistent storage precisely after the last time it was updated, with little or no expectation for being updated again anytime soon.
Traditional approach is "Least Recently Used" or [LRU]. Cache entries that were read recently or updated recently, would be placed on the top of the list, and the least referenced would be at the bottom of the list. When space is needed in cache, the entries at the bottom of the list would be kicked out.
IBM's [Adaptive Cache Algorithm outperforms LRU]. For example, on a workstation disk drive workload, at 16MB cache, LRU delivers a hit ratio of 4.24 percent while ARC achieves a hit ratio of 23.82 percent, and, for a SPC1 benchmark, at 4GB cache, LRU delivers a hit ratio of 9.19 percent while ARC achieves a hit ratio of 20 percent.
But caching algorithms, including IBM's Adaptive Cache, are not cognitive. These algorithms respond pragmatically based on the current state of the cache. Cognitive solutions learn, and improve with usage. This is often referred to as "Machine Learning".
The human-computer interface (HCI) has much room for improvement in a variety of areas.
Take for example a snack vending machine. In college, we had assignments to simulate the computing logic of these. We had to interact with the buyer, receive coins entered into the slot--nickels, dimes and quarters representing 5, 10 and 25 cents--determine a total monetary balance, and then dispense snacks of various prices and return an appropriate amount of change, if any. There is even a [greedy algorithm] designed to optimize how the change is returned.
But vending machines are not cognitive. Like the caching algorithms, vending machines interact based on fixed programmatic logic, treating all buyers in the same manner. Cognitive solutions can interact with different users in different ways, customized to their needs, and these interactions can improve over time, based on machine learning.
IBM is exploring the use of Cognitive Solutions in a variety of different industries, from Healthcare to Retail, Financial Services to Manufacturing, and more.
technorati tags: IBM, Barry Whyte, Cognitive+University, cognitive computing, Pascal Compiler, CDC, Electrical Engineer, LRU, caching algoritm, Adaptive Cache, human-computer interface, HCI
Well, it's Tuesday again, and you know what that means? IBM Announcements!
(Yes, OK, it's actually Thursday. I wrote this post weeks ago, but was embargoed until Jan 10, and then was asked to wait until Jan 12 so that the IBM Marketing team could translate my text into 15 different languages.)
This week, the IBM DS8000 team announces a new High Performance Flash Enclosure (HPFE-Gen2) and a series of All-Flash Array DS8880F models that exploit this new technology.
- New High Performance Flash Enclosure (HPFE-Gen2)
The original HPFE was 1U high with 16 or 30 flash cards, and could support RAID-5 or RAID-10. Most used RAID-5, resulting in four array sites of 6+P each, leaving two cards for spare. These 1.8-inch cards were only 400 or 800 GB in size, so the maximum raw capacity was only 24TB per 1U enclosure.
The new HPFE-Gen2 enclosure is a complete re-design, consisting of two Microbays and two TeraPacks. The I/O Bays attach to the Microbays via PCIe Gen3. The Microbays in turn attach to both TeraPacks via redundant 6 Gb or 12 Gb SAS.
Each TeraPack holds 24 flash cards each. Since the TeraPacks come in pairs, you can install 16, 32 or 48 flash cards per enclosure. Each 16-card set represents two array sites, for a maximum of six array sites per HPFE-Gen2.
- RAID-5 for 400/800 GB. Two 6+P arrays, four 7+P arrays, and two spares.
- RAID-6 for 400/800/1600/3200 GB. Two 5+P+Q arrays, four 6+P+Q arrays, and two spares.
- RAID-10 for 400/800/1600/3200 GB. Two 3+3 arrays, four 4+4 arrays, and four spares.
(Technically, these new "Flash cards" are 2.5-inch Solid State Drives (SSD) placed into the HPFE Gen2 connected to the PCIe Gen3 interface, with 50 percent additional capacity to tolerate up to 10 drive-writes-per-day (DWDP). IBM will continue to call them "Flash Cards" for naming consistency between the two generations of HPFE.)
The new HPFE-Gen2 enclosures are substantially faster, offering up to 90 percent more IOPS, and up to 268 percent more throughput (GB/sec). The Microbays use a new flash-optimized ASIC to perform the RAID calculations.
- New All-Flash Array DS8880F models
IBM introduces the DS8884F, DS8886F and DS8888F that are based entirely on the HPFE-Gen2 enclosures described above.
Hybrid - HDD/SSD/HPFE mix
Hybrid - HDD/SSD/HPFE mix
AFA - HPFE only
AFA - HPFE-Gen2 only
AFA - HPFE-Gen2 only
AFA - HPFE-Gen2 only
- New zHyperLink connection
- Also, as a "Statement of Direction", IBM intends to deliver field upgradable support for zHyperLink on existing IBM System Storage DS8880 machines for connection to z System servers. zHyperLink is a short-distance, mainframe-attach link designed for lower latency than High Performance FICON.
Typical latency with FICON/zHPF is around 140-170 microseconds, and this new zHyperLink is estimated to reduce this down to 20-30 microseconds, but is limited to 150 meter fiber optic cable distance. zHyperLink is intended to speed up DB2® for z/OS® transaction processing and improve active log throughput.
To learn more, read the Announcement Letters for [IBM DS8880 all-flash family meets the demand for high-speed storage] and [IBM DS8880 All-Flash family Function Authorizations].
The new HPFE-Gen2 architecture design, and the All-Flash Array models they are based on, positions IBM well into the future for newer 2.5-inch SSD capacities and technologies as they become available.
technorati tags: IBM, DS8000, All-Flash Array, HPFE, HPFE-Gen2, DS8884F, DS8886F, DS8888F, zHyperLink
Last month, I had the pleasure to help train Watson in its latest mission, to help answer questions from sellers, this are not just for the IBM feet on the street, but also for IBM distributors and IBM Business Partners as well.
In their post [Workers Spend Too Much Time Searching for Information], Cottrill Research explains the problem all too well. Here is an excerpt:
"... [survey by SearchYourCloud] revealed 'workers took up to 8 searches to find the right document and information.' Here are a few other statistics that help tell the tale of information overload and wasted time spent searching for correct information -- either external or internal:
- 'According to a McKinsey report, employees spend 1.8 hours every day -- 9.3 hours per week, on average -- searching and gathering information. Put another way, businesses hire 5 employees but only 4 show up to work; the fifth is off searching for answers, but not contributing any value.' Source: [Time Searching for Information]
- '19.8 percent of business time -- the equivalent of one day per working week -- is wasted by employees searching for information to do their job effectively,' according to Interact. Source: [A Fifth of Business Time is Wasted]
- IDC data shows that 'the knowledge worker spends about 2.5 hours per day, or roughly 30 percent of the workday, searching for information ... 60 percent [of company executives] felt that time constraints and lack of understanding of how to find information were preventing their employees from finding the information they needed.' Source: [Information: The Lifeblood of the Enterprise]."
In the early days of the Internet, before search engines like Google or Bing, I competed in [Internet Scavenger Hunts]. A dozen or more contestants would be in a room, and would be given a list of 20 questions to find answers for. Each of us would then hunt down answers on the Internet. The person to find the most documented answers before time runs out wins. It was quite the challenge!
Over the years, I have honed my skills as a [Search Ninja]. With over 30 years of experience in IBM Storage, many sellers come to me for answers. Sometimes sellers are just too lazy to look for the answers themselves, too busy trying to meet client deadlines, or too green to know where to look.
A good portion of my 60-hour week is spent helping sellers find the answers they are looking for. Sometimes I dig into the [SSIC], product data sheets, or various IBM Redbooks.
Other times, I would confer with experts, engineers and architects in particular development teams. Often, I learn something new myself. In a few cases, I have turned some questions into ideas for blog posts!
It was no surprise when I was asked to help train Watson for the new "Systems SmartSeller" tool. This will be a tool that runs on smartphones or desktops to help answer questions that sellers might need to respond to RFP or other client queries.
The premise was simple. Treat Watson as a student at "Cognitive University" taking classes from dozens of IBM professors, in a series of semesters, or "phases".
Phase I involved building the "Corpus", the set of documents related to z Systems, POWER systems, Storage and SDI solutions; and a "Grading Tool" that would be used as the Graphical User Interface. I was not involved in phase I.
Phase II was where I came in. Hundreds of questions are categorized by product area. I worked on 500 questions for storage. For each question, Watson had up to eleven different responses, typically a paragraph from the Corpus. My job as a professor was to grade the responses to some 500 storage questions:
|★ (one star)
||Irrelevant, answer not even storage-related
|★★ (two stars)
||Relevant, at least it is storage-related, but does not answer the question, or answers it poorly
|★★★ (three stars)
||Relevant, adequately answers the question
|★★★★ (four stars)
||Relevant, answers the question well
Most of the answers were either 1-star (not storage related) or 2-star (mentioned storage, but poor response). I would search through the existing Corpus looking for a better answer, and at best found only 3-star responses, which I would add to the list and grade as a 3-star response.
I then searched the Internet for better answers. Once I found a good match, I would type up a 4-star response, add it to the list, and point it to the appropriate resources on the Web.
Other professors, who were also looking at these questions, would then get to grade my suggested responses as well. Watson would learn based on the consensus of how appropriate and accurate each response was graded.
I don't know where the Cognitive University team got some of the questions, but they were quite representative of the ones I get every week. In some cases, the seller didn't understand the question he heard from the client, making it difficult for me to figure out what they were actually asking for.
It reminds me of that parlor game ["Telephone" or "Chinese Whispers"], in which one person whispers a message to the ear of the next person through a line of people until the last player announces the message to the entire group. I have actually played this at an IBM event in China!
Watson needs to parse the question into nouns and verbs, and use that Natural Linguistic Programming (NLP) to then search the Corpus for appropriate answer. I determined three challenges for Watson in this case:
- The questions are not always fully formed sentences. For example, "Object storage?" Is this asking what is object storage in general, or rather what does IBM offer in this area?
- The questions often do not spell the names of products correctly, or use informal abbreviations. "Can Store-wise V7 do RtC?" is a typical example, short for "Can the IBM Storwize V7000 storage controller perform Real-time Compression?"
- The questions ask what is planned in the future. "When will IBM offer feature x in product y?" I am sorry, but Watson is not [Zoltar, the fortune teller]!
I managed to grade the responses in the two weeks we were given. Part of my frustration was the grading tool itself was a bit buggy, and I spent some time trying to track down some of its flaws.
The next phase is in late January and February. This will give the Cognitive University team a chance to update the Corpus, improve the grading interface, and find more professors and different set of questions. I volunteered the most recent four years' worth of my blog posts to be added to the Corpus.
Maybe this tool will help me turn my 60-hour week back to the 40-hour week it should be!
technorati tags: IBM, Watson, Cottrill Research, SearchYourCloud, McKinsey, IDC, Google, Bing, Search Ninja, Internet Scavenger Hunts, SSIC, Telephone Game, Chinese Whispers, NLP, RFP, Storwize, RtC, Zoltar, Cognitive University
Modified by TonyPearson
Fellow blogger Chris Mellor from The Register has an interesting post titled [It's a ratchet: Old storage guard face incoming tech squeeze]. Chris opines that the big traditional storage vendors -- which he refers to as the "old guard": Dell EMC, HDS, HPE, IBM and NetApp -- are being squeezed out by startups with new technologies.
Last week, I saw the play [Fiddler on the Roof], a musical production by Arizona Theater Company (ATC), and thought of various parallels with Chris's post.
For those not familiar, the story centers around a father named Tevye and his wife trying to stick to tradition, with five daughters who are open to breaking with tradition to get married. The family lives in a small rural town, back in a time long ago when people were persecuted for their religious and ethnic background. Aren't you glad we live in [more enlightened times]!
Back to Chris Mellor, he writes in his post:
"This old guard has so far failed to squash newcomers in the all-flash array, hyperscale, object and software-defined storage areas. This is despite the established firms adopting these technologies and acquiring some startups."
Should the old guard try to squash newcomers? Often, these startups provide much needed innovations that move the IT industry forward.
In the play, Tevye wants to stick to tradition, whereby the town's matchmaker would find a husband for each daughter, and he, as father of each bride, would then provide his permission and blessing to the match.
Obviously, these startups are neither asking the old guard for their permission nor their blessing. While I can't speak for the rest of the "old guard", IBM is leading in these various spaces. Let's look at each of these new trends.
- All-Flash Arrays (AFA)
The category of "All-Flash Arrays" include both purpose-built hardware as well as traditional devices based on solid-state drives (SSD). While the R&D investment needed for purpose-built hardware can limit this to some of the largest vendors, nearly any startup can slap commodity SSD into traditional HDD controllers and call it AFA.
IBM offers the world's fastest AFA, and has been a leader in the AFA category for the past three years, investing over $1 Billion USD on its FlashSystem, DS8000, Elastic Storage Server (ESS), SVC and Storwize product families.
- Software-Defined Storage (SDS)
While the definition for SDS is still in a bit of flux, IDC has tried to identify three characteristics:
- Storage software stack that can be installed on commodity resources (x86 hardware, hypervisors, or cloud) and/or off-the-shelf computing hardware
- SDS should offer a full suite of storage services
- Federation between the underlying persistent data placement resources to enable data mobility of its tenants between these resources
IBM has been ranked [Number 1 in Software Defined Storage] for several years now, investing over $1 Billion USD in its IBM Spectrum Storage family. This collection of software is implemented in a variety of offerings, including pre-built systems, software that you can deploy on commodity off-the-shelf servers, and in the Cloud.
- Object storage
Object storage breaks tradition with block and file-based storage solutions. Rather than reading and writing files using POSIX, NFS or SMB protocols, objects are accessed via HTTP GET and PUT requests. The two most common protocols are Amazon S3 and OpenStack Swift.
Object storage is ideal for static and stable data that either never changes, or changes infrequently. A lot of new workloads are based on unstructured data that falls in this category, such as Big Data Analytics, High-performance Computing (HPC), and active archives.
In the latest IDC Marketscape, [IBM is ranked #1 in Object Storage]. IBM has actually three software-defined storage offerings that support Object access methods. IBM Spectrum Scale, IBM Spectrum Archive and IBM Cloud Object storage System. The latter from 2015 acquisition of Cleversafe.
- Hyperscale storage
For those not familiar with hyperscale storage, here is a definition from [Hyperscale Storage for Dummies]:
"Hyperscale leverages commodity servers and a software-defined approach, scaling the resources needed for applications and storage separately. As storage needs grow, companies can add servers running software-defined storage (SDS) to the storage tier to expand capacity... Data is automatically distributed across the entire cluster of storage servers as new nodes are added to the system... With hyperscale, .. cluster nodes network together to form a storage resource pool."
This breaks from the tradition of dual-controller high-end arrays, which scale-up, rather than scale-out. IBM offers its IBM Spectrum Accelerate, IBM Spectrum Scale, and IBM Cloud Object Storage System to fill this hyperscale requirement.
In the play, Tevye realizes the world is changing all around him, he can either fight these changes and stick to tradition, or accept that he must change also, and move on. After 105 years, IBM continues to lead the IT industry, primarily by adopting new trends and technologies, moving to new business opportunities as they present themselves.
technorati tags: IBM, Chris Mellor, The Register, Fiddler on the Roof, Arizona Theater Company, All-Flash Array, AFA, FlashSystem, DS8000, Elastic Storage Server, ESS, SAN Volume Controller, SVC, , Storwize, IDC, Software-defined Stroage, SDS, Spectrum Storage, object storage, Spectrum Scale, Spectrum Archive, IBM Cloud Object Storage, POSIX, NFS, SMB, HTTP, Amazon S3, OpenStack Swift, Hyperscale Storage, Spectrum Accelerate
IBM is doing a bit of year-end housekeeping. The Storage Community (storagecommunity.org) will be discontinued as of January 1, 2017.
IBM will continue to host a community for all of its followers and contributors to share insights on the latest trends in storage at [ibm.co/StorageSolutions].
All of the most recent IBM content from storagecommunity.org will now be available at this new domain. IBM hopes that you will continue to engage in its community of storage industry thought leaders.
If you would like to contribute to the new community, please [register here]. Simply click the silhouette icon in the top right-hand corner of the page and select "register." Input your email address and create a password, then sign in. You will receive an email from IBM with further instructions to get you set up.
IBM's twitter handle (@SmarterStorage) will also be sunset as of January 1, 2017, but I encourage you to follow @IBMStorage, or my own twitter handle @az990tony, for the latest storage news and announcements from IBM.
Modified by TonyPearson
Last Thursday, Dec 15, I had the pleasure to present to 162 clients and IBM Business Partners, followed by the premiere showing of [Rogue One, a Star Wars movie]!
(FCC Disclosure: I work for IBM. This blog post can be considered a "paid celebrity endorsement" for IBM products and services. I have no financial interest in Lucasfilm Ltd, or its parent company Disney, LEGO company, or any competitor mentioned in this post.. I was not compensated to review this film or mention it on my blog. All graphics from the film used in this blog and related presentation were publicly available under the U.S. "fair use" doctrine. There are no spoilers in this blog, so keep reading!)
This event was a collaboration between:
- Arrow, one of IBM's distributors
- Corus360, an IBM Business Partner
- Regal Medlock 18, a theater with comfy seats with a bar that serves beer and wine
As a public speaker for IBM, I get to travel all over the world, and throughout the United States. This trip wraps up my travel for 2016, with 34 weeks on the road!
Normally, when I am asked to present, I am given a list of products or topics to cover. This time, I was just given the title "Has Your Data Gone Rogue? -- Using IBM Flash and solutions to obtain enhanced business insights" and the suggestion to keep within the theme of Star Wars.
I had 45 minutes to cover whatever I thought would be something of interest to the clients in the audience, which spanned a variety industries from Healthcare and Financial services, to Retail and Manufacturing.
I turned to mind-mapping software to brainstorm some ideas. On my smartphone, I use an app called [SimpleMind], and on my laptop, I use [View Your Mind (vym)]. Here is what I came up with:
I arrived to the theater early to setup and mingle with the clients in the lobby. The sponsors that organized this event had gifts to raffle off, including two drones, and three Star Wars themed LEGO sets.
I was told to be done by 7:30pm. It turns out that the movie is streamed electronically, rather than having the actual media distributed physically to the theaters, as a way to prevent piracy.
My PowerPoint charts were in 16:9 format to fill the screen. This was perhaps the biggest screen I had ever presented on! I look so tiny in comparison!
IBM has been a leader in all-flash arrays for the past three years in a row, and as an IBM Business Partner, Corus360 has been one of our top sellers in the Southeastern United States. IBM offers a wide array of choices, from DS8000 to FlashSystem to the new [IBM DeepFlash Elastic Storage Server (ESS)].
Rebels are inquisitive. IBM is considered number one in Analytics. For every type of question, IBM has analytics to help answer. Here are some examples:
- What is happening? -- Descriptive Analytics
- Why did this happen? -- Diagnostic Analytics
- What might happen next? -- Predictive Analytics
- What actions should we take? -- Prescriptive Analytics
I focused on the use of Hadoop and Spark with the [IBM Spectrum Scale] software pre-installed on the DeepFlash ESS device. The DeepFlash ESS combines powerful POWER8 servers with the DeepFlash 150, a 3U high JBOF that holds up to 64 solid-state boards 8TB each, optimized for analytics of unstructured data content.
Spectrum Scale is supported on any open source distribution of Hadoop and Spark, and is an optional add-on to [IBM BigInsights]. [IBM HDFS Transparency Connector] has 100 percent compatibility, allowing Hadoop and Spark analytics programs run directly without modification.
To provide valuable insight to the storage environment itself, IBM offers IBM Spectrum Control. The newest edition is [IBM Spectrum Control Storage Insights], a Software-as-a-Service (SaaS) that charges on a monthly per-capacity basis. Perfect for the Rebel Alliance on a tight budget and schedule!
The Galactic Empire has a different set of problems. They are behind schedule, having worked on the Death Star for the past 20 years, and upper management is growing impatient. A major test is imminent to prove its progress.
To speed development and test efforts, IBM offers a variety of FlashSystem products:
- IBM FlashSystem 900
- the World's Fastest Storage®, roughly 5 to 10 times faster than competitors based on commodity Solid State Drives (SSD) like Dell EMC XtremIO and PureStorage.
- IBM FlashSystem V9000
- adds the robust functionality of IBM Spectrum Virtualize, with Real-time Compression, Thin Provisioning, FlashCopy snapshots, and remote mirroring. Like the IBM SAN Volume Controller and Storwize family of products, the FlashSystem V9000 can virtualize almost 400 different storage devices from a variety of vendors.
- IBM FlashSystem A9000 and A9000R
- add the robust functionality of IBM Spectrum Accelerate, offering Real-time compression and data deduplication, making it ideal for Cloud, Virtual Machine and Virtual Desktop deployments.
As we learned in earlier episodes I to III of the Star Wars saga, a big problem was too many clones. IBM Spectrum Storage family has introduced the newest member: IBM Spectrum Copy Data Management. This software creates and catalogs data base clones to help with development and test efforts, reducing the number of rogue copies.
Lastly, the Empire must keep its secrets safe and protected. I covered the basics of data-at-rest encryption, the use of symmetric and asymmetric keys, [IBM Security Key Lifecycle Manager (SKLM), and how these are deployed on IBM flash, disk and tape products.
Then, we watched the movie. I found it quite entertaining!
technorati tags: IBM, #360RogueOne, Star Wars, Rogue One, Arrow, Corus360, Regal Medlock, SimpleMind, View Your Mind, mindmap, LEGO, DeepFlash, Elastic Storage Server, IBM Analytics, Spectrum Scale, IBM+BigInsights, HDFS Transparency, Spectrum Control, Storage Insights, Rebel Alliance, Galactic Empire, Death Star, FlashSystem, FlashSystem 900, FlashSystem V9000, FlashSystem A9000, FlashSystem A9000R, Spectrum Copy Data Management, Data-at-Rest Encryption, Security Key Lifecycle Management
Modified by TonyPearson
Well, it's Tuesday again, and you know what that means? IBM Announcements!
I just got back from my vacation, so this is a guest post from my colleagues Moshe Weiss, Senior Manager, Development and Design, IBM Storage; and Diane Benjuya, Portfolio Marketing Manager for IBM Spectrum Accelerate.
1. What is IBM announcing?
Today IBM announces another leap forward in storage management, with the availability of IBM Hyper-Scale Manager version 5.1. In April 2016, when IBM announced IBM FlashSystem A9000 and A9000R, they also introduced a fully revamped GUI: IBM Hyper-Scale Manager 5.0. That version brought FlashSystem A9000/A9000R clients a terrific new storage management experience, with advanced look and feel, analytics tools, and other enhancements for managing smarter, with greater simplicity and in less time.
Hyper-Scale Manager 5.x dramatically reduces task time -- by 45% for this task
With Hyper-Scale Manager 5.1, IBM is bringing this exceptional GUI and unified user management experience across the entire set of Spectrum Accelerate-based products, which IBMers internally refer to as the "A family":
- IBM Spectrum Accelerate software
- IBM XIV Storage System
- FlashSystem A9000
- FlashSystem A9000R
IBM Hyper-Scale Manager lets you view and move quickly across software-defined, disk based, and all-flash storage in seconds, equipping you with the information you need to ensure every application is performing at its peak.
2. What is innovative about the new GUI -- how does it help clients?
IBM Hyper-Scale Manager 5 makes storage management more insightful and easier in multiple ways, helping clients find info, act and troubleshoot faster. Concepts implemented include: web application with tablet-ready design, single page application, strong navigation scheme, smart filter with analytics, capacity trend/forecast, call for action, better communication using social media. All this helps users make fast, informed decisions while being able to see at a glance the impact of any change on the environment, including into the future. IBM team has designed it over the past three years working closely with clients and using Design Thinking methodology.
Get a holistic view of your storage
Provisioning, Monitoring and Troubleshooting
Find everything, get anywhere
Call for action!
The IBM team applied an "emotional design" approach that makes users feel emotionally attached to GUI for its coolness and elegance -- making the experience not just more productive but also more pleasant.
(New to the concept? Consider reading [What is emotional design] on Quora.)
3. What is enhanced in this version?
Version 5.1 brings many exciting and important new features to ease the client's day to day activities. Here are some key ones:
Managing your "A Family" in one UI
Instantly gain insights, spot problematic areas
Integrated Capacity Analytics
4. Any unique features that will be focused on?
The IT industry is entering a cognitive era, right? So IBM has brought cognitive into the GUI. The GUI actually learns each user's habits and preferences over time and adapts the experience to the specific user.
5. How does 5.1 add value to the family of products based on Spectrum Accelerate software?
Hyper-Scale manager makes this powerful family for private, public, hybrid block storage clouds that much more attractive and relevant. Just imagine yourself:
- Waking up, driving to the office, opening the UI and seeing that your FlashSystem A9000 systems are doing worse than your XIV in terms of IOPS. Scary, but no worries.
- You drill down to the specific FlashSystem A9000 by comparing IOPS. You find that a QoS performance class is deliberately reducing performance for the host. A quick analysis, and you find that it is due to the contract with the host. After a short chat with the host admin, you establish better terms, and decide to stop the IO limitation on the volumes and move them to a disk-based XIV to reduce dollar-per-TB cost.
- You look for the best candidate by looking at the capacity trend/forecast charts for each XIV and at growth rate per month. You compare performance metrics and chose the preferred XIV to move the volumes to.
- You migrate the volumes from the A9000 to the chosen XIV using the same interface, creating connectivity in one click. You then add the same host configuration as for the A9000 to the XIV in a second click. Then just map and monitor the new IO statistics with a third click. Easy!
Imagine carrying out your daily work and decisions -- creating volumes, monitoring, mirroring, troubleshooting and configuring -- across different systems of different types within the family in single clicks -- without the need to move between user interfaces. You can think of Hyper-Scale Manager 5.1 as a GUI come alive: a dynamic, breathing, thinking work enhancer that simplifies and helps you make the most of your investment.
Come see it in action! Register now for the [Live demo webinar], scheduled for Wednesday, November 9, 2016, from 10am to 11:30am MST!
Download the software from [IBM Fix Central], installation is one click and takes just seconds!
Here is an infographic!
Comments? Feedback? Enter them below. Both Moshe and Diane would be pleased to hear from you!
technorati tags: IBM, Moshe Weiss, Diane Benjuya, Spectrum Accelerate, Hyper-Scale Manager, XIV, FlashSystem A9000, FlashSystem A9000R, design thinking, emotional design
Well, it's Tuesday again, and you know what that means? IBM Announcements!
(OK, yes, today is Friday, but I was busy getting married on Tuesday, so IBM pushed the announcements out one day to Wednesday, and technically I am writing this blog post during my honeymoon vacation, so the IBM marketing team and my new wife both cut me some slack. Work/Life balance is all about compromises, right?)
- IBM DS8880 Storage System
The IBM DS8880 comes in three models, the DS8884 entry level, the DS8886 enterprise level, and the DS8888 all-flash array. IBM offers 1, 2, 3 and 4 year warranties.
The new High Performance Flash Enclosure (HPFE) Gen2 delivers more capacity than Gen1. The 2U flash enclosures are configured in pairs with each enclosure supporting up to twenty-four 2.5-inch flash cards in capacities 400 GB, 800 GB, 1.6 TB and 3.2 TB.
The HPFE Gen2 are currently available for both the DS8884 and DS8886 models. The maximum flash capacity for the DS8886 increases from 96 TB to 614.4 TB, delivering reduced storage costs through lesser cost per IOPS with this new flash enclosure. IBM has made a statement of direction to offer these HPFE Gen2 on the DS8888 as well.
To improve security, IBM DS8880 now supports customer-defined digital certificates for authentication, and configurable Hardware Management Console (HMC) firewall support.
For IBM's mainframe clients, IBM now offers "Extents-level" space release support for z/OS®, DSCLI (Command Line Interface) support for z/OS environment, and FICON® Information Unit (IU) pacing improvements.
My blog post [Re-Evaluating RAID-5 and RAID-6 for slower larger drives] helped to convince upper management to make RAID-6 the default protection level in R8.2 release.
To learn more, see [ IBM DS8880 storage family delivers a series of flash-enclosure models] press release.
- IBM Spectrum Virtualize™ V7.8
IBM Spectrum Virtualize™ V7.8 delivers support for the latest SAN Volume Controller, FlashSystem V9000 and Storwize® product family, and adds new software functionality and improvements
In conjunction with [IBM Spectrum Copy Data Management], Spectrum Virtualize v7.8 offers flexible data protection with transparent cloud tiering to leverage the cloud as FlashCopy targets and restore these snapshots from the cloud on select platforms.
In my September blog post [IBM Edge 2016 Day 3 Wednesday Breakout Sessions] I gave a quick recap of how IBM Spectrum Virtualize offers data-at-rest encryption for both internal and external drives.
However, the encryption keys are kept on USB thumb drives, which are either left in the USB ports on the back of the hardware, or locked away in a safe, only to be retrieved as needed when rebooting the systems or upgrading the firmware.
Now, IBM Spectrum Virtualize v7.8 supports the IBM Security Key Lifecycle Manager (SKLM) to manage encryption keys. IBM continues to support USB thumb drives if you prefer, but SKLM is used to manage keys for most of the rest of IBM products, and provides centralized management.
To learn more, see [ IBM Spectrum Virtualize Software V7.8] press release.
- IBM SAN Volume Controller and Storwize
The SVC and Storwize models can directly attach via 12Gb SAS to expansion drawers. At the time, we supported 2U-high 12-bay that support Large Form Factor (LFF) 3.5-inch Nearline (7200 rpm) drives, and 2U-high 24-bay that support the Small Form Factor (SFF) 2.5-inch drives (SSD, 15K, 10K and 7200 rpm).
With Spectrum Virtualize v7.8, IBM now offers a third option, the 5U-high 92-bay that supports both LFF and SFF drives. This new expansion can be attached to Storwize V5000 Gen2, Storwize V7000 (models 524/Gen2 and 624/Gen2+), and SVC (models DH8 and SV1).
For the 12-bay and 92-bay, IBM now supports 10TB capacity 3.5-inch Nearline drives. For the 24-bay and 92-bay, IBM now supports 7.68 TB and 15.36 TB capacity Solid State Drives (SSD).
For those concerned about the phrase "lower endurance" in the press release, let me explain. SSD have a bit of extra capacity included. If you write the full capacity of the drive every day for a year, you will "burn up" about one percent of the capacity.
To handle ten "Full Drive Writes per Day" (10 FDWP) over the course of five years, IBM adds 50 percent extra spare capacity above the 400 GB, 800 GB, 1.6 TB and 3.2 TB capacities. So, a 400GB full-endurance drive is really 600 GB inside. These were sometimes referred to as "Enterprise" SSD.
For the larger device sizes, the IT industry has determined that 1 FDWP is sufficient, so instead of 50 percent spare capacity, IBM adds only 5 percent extra. The 7.68 TB is really 8.06 TB inside. These were earlier referred to as "Read-Intensive" SSD. These come in 1.92 TB, 3.84 TB, 7.68 TB and 15.36 TB capacities.
IBM is also offering non-disruptive model conversions. Storwize V5010 can now be converted to V5020, and V5020 can be converted to V5030. The Storwize V7000 Model 524 (Gen2) can be converted to model 624 (Gen2+).
To learn more, see [ IBM SAN Volume Controller and Storwize family high-density expansion] press release.
- IBM FlashSystem V9000
The IBM FlashSystem V9000 will also support its own version of 5U-high, 92-bay, but to simplify ordering, will only support the following drive types:
- High-capacity, archival-class Nearline disk drives in 8 TB and 10 TB 7,200 rpm
- Flash drives in 1.92 TB, 3.84 TB, 7.68 TB, and 15.36 TB
To learn more, see [ IBM FlashSystem V9000 HD Expansion Enclosure Model 92F] press release.
- IBM DeepFlash Elastic Storage Server (ESS)
The DeepFlash 150 is the perfect JBOF addition to the ESS family. The current ESS models had either 2U-high 24-drive bays, or 4U-high 60-drive bays. This new model is 3U-high with 64 high-capacity (8 TB) Board Solid State Drives (BSSD).
The ESS includes all the features of IBM Spectrum Scale, including both 8+2 and 8+3 Erasure Coding data protection. This provides file and object access to data, including POSIX compliance for Windows, Linux and AIX operating systems, as well as HDFS-compliant access for big data analytics.
To learn more, see [IBM DeepFlash Elastic Storage Server] landing page.
By now, there are multitude news articles on these announcements, so I recommend you go look for them.
technorati tags: IBM, DS8880, DS8884, DS8886, High Performance Flash Enclosure, HPFE, DSCLI, FICON, Spectrum Virtualize, Data-at-Rest Encryption, Spectrum Copy Data Management, Transparent Cloud Tiering, SAS, NL-SAS, LFF, SFF, FDWP, FlashSystem V9000, DeepFlash 150, DeepFlash ESS, Elastic Storage Server, Erasure Coding, Widows, Linux, AIX, BSSD
Last month, I presented at the "IBM Technical University" event in beautiful Atibaia, Brazil. Here is my recap of the event.
- Marcelo Porto, IBM General Manager for Brazil and Client Unit Executive for Retail
What a great way to start a conference! Marcelo asked if everyone was comfortable? Everyone cheered in the affirmative.
He then said "Well, not for long. We will take you out of your comfort zone! You will disrupt yourself, and disrupt your companies. You will learn about new technologies and solutions that will make you very uncomfortable."
He explained how everything is virtual, specifically the three companies Airbnb, Waze, Uber. All of these three have new transformational business models, and he suggested all companies should follow suit.
He then said people need to be focused on four things:
- Adopting an "agile attitude"
- Act like you own the company
- Don't cling to the past
- Have the courage to re-invent yourself and your company
- Frank Koja, IBM Vice President for Sales, Enterprise Systems Hardware
Business [decisions are made with only 12% of available data]. Infrastructure needed to use data to make business decisions.
(Managers and business leaders could probably raise this percentage considerably if they talked to their employees before making decisions, but that's another blog post!)
Frank showed a video of an IBM client, Plenty of Fish (POF). This is a worldwide dating site with three million POF members in Brazil. They now process over 30,000 requests and/or messages per minute. FlashSystem connected to 30 servers makes that possible.
OpenPower consortium started with just 5 companies in 2014 for technology collaboration. Today, 250 members across 26 countries in six continents collaborate to make POWER technology as ubiquitous a commodity as Intel x86.
Frank then switched to "Business models" innovation. Out of the audience of about 800 people, only 10 raised their hands that have heard of Blockchain (he asked IBMers not to raise their hands, as all IBMers have heard of Blockchain!).
Frank feels that Blockchain is the most disruptive innovation since Internet banking. Blockchain affects supply chain, finance, insurance, shipping logistics, customs inspections, and government registrations.
A video showed a woman from Everledger, which uses Blockchain for shipping diamonds. IBM offers Blockchain on LinuxOne mainframe servers.
Hybrid Cloud is point of no return, including Local, Dedicated and Public clouds. Frank feels we need to cloudify all business processes.
- Mauro Angelo, IBM Enterprise Strategy & Industry Solutions Director
Mauro explained that ideas are turned into inventions, and inventions are put to good use to bring forth innovations.
If your business is not cognitive you are a full era behind. Machine learning is not knew. IBM DeepBlue beat Grandmaster in Chess tournament back in 1997.
Mauro then focused on eight specific trends:
- Systems of Engagement (SoE)
This is the combination of Mobile applications and Social business. IBM invited the first smartphone, the Simon, back in 1994. Apple's iPhone came later in 2007. Pokemon Go is example of augmented reality.
Cloud offers new service and location models. IBM [SoftLayer], [Bluemix], and [Kenexa] are a few examples.
- Cognitive computing
There have been a lot of enhancements in this space, including Natural Language Processing (NLP), visual recognition, even smell recognition. Cognitive solutions can also identify the appropriate context, such as GPS location. And Cognitive solutions can interact with users to ask for clarifications. It can process "Big Data", the collection of non-structured data that normal Relational Database Management Systems (RDBMS) do not touch. Finally, they can learn, something often referred to as "Machine Learning".
In 2011, IBM Watson beat two humans at the TV show game Jeopardy! Today, [Dino, a toy from CogniToys] provides Watson-like capabilities to children.
Mauro got one for his daughter. She naturally interacts with toy. "How much does an elephant weigh?" she asks. "It depends on the elephant, but a fully grown elephant weighs more than 2,000 kilos" it responds. That's cool.
Wearables like Fitbit can track blood pressure, minutes of exercise, total steps walked. IBM helped Under Armour company develop an app in this space.
Eliminates middlemen or trusted third party (TTP). The hotel chain, Hilton, is testing out a robot called Pepper, which can use Blockchain to book tennis courts.
These are technologies thinner than a strand of hair, measured in nanometers. The focus is to develop stronger, lighter materials, and macromolecules for life sciences for medicine delivery.
- 3D printing
Mass customization meets personalization and fast design prototypes. This is not just limited to plastic, but also metal, paper, wood, biomaterials, ceramics, food, and even cement.
Cement? That's right. A Chinese company prints houses using a cement 3D printer. In a country of over one billion people, this company has figured out how to build houses without human laborers.
- Internet of Things (IoT)
Olli, a 12-person self-driving bus, is the brainchild of Local Motors. They are testing it out in National Harbor, and hope to roll it out to cities like Copenhagen, Miami, and Las Vegas.
- Luis Liguori, IBM Distinguished Engineer and CTO for IBM Brazil
What does IBM mean by "Digital transformation?" What separates success from failure? Developed countries from less developed countries?
Is it culture? Whether people focus on the long term, or just the short term? Does the culture encourage you to foresee the future, and adapt accordingly? Does the culture encourage you to be brave and bold? Do you hide behind Business case return on investments (ROI)? Does your culture consider conflict to be good or bad? The answer: Good!
Does your company have a purpose? When humans no longer serve purpose, they die. The same is true for companies. He said the secret to success is the four "R's" -- Relevant, Resources, Reputation and Rigor.
For example, in 1996, the Kodak was ranked the 4th largest, it filed bankruptcy in 2012 because it was no longer relevant.
Consider Samsung. Samsung has lost its reputation with the latest "Samsung Galaxy Note7" fiasco of exploding batteries!
Airbnb is an example of Digital Transformation. Who knew that there were lots of people who wanted to rent out their bedrooms and bathrooms to strangers!
Luis feels that successful companies are either born digital, or transforming to digital. Industries are merging. Lines are blurring between industries. The latest acquisition between AT&T and Time Warner is an example.
In the latest report from the International Monetary Fund, World Economic Outlook, [Brazil dropped down to 81, out of 138 countries]. Despite hosting the FIFA and Olympics, the country has been struggling financially.
Cognitive brings intelligence to decision making. For example, Watson health has been put to task to focus on Leukemia. In one case, Watson was able to [pinpoint a rare form of Leukemia] that had misdiagnosed and being treated incorrectly with little effect.
Why cognitive? Because human beings cannot read or remember as well as computers. There are thousands of peer-reviewed articles published every day. People are afraid to act to avoid mistakes. Computers are fearless.
Did you know that Brazil celebrates "Black Friday"? There is no "Thanksgiving" in Brazil, but retailers liked the idea of having people stand outside in the middle of the night to start their Christmas shopping! A few years ago, there were [a few problems], but in most recent years, it has shown to help [boost retail sales.] Based on these initial purchases, Watson can be used to help drive the rest of the Christmas retail season.
Watson can analyze personality based on social media writings. The world will be taken over by digital natives. The last century was focused inward, or "ego-centric", but in this 21st century, we will be focused outward, towards a complete "ecosystem".
Who are your competitors? Are they the companies that make products and services similar to yours? No! They are the companies that are competing for your customer's time and attention.
- Breakout Sessions
While I speak English and Spanish fluently, my Brazilian Portuguese is terribly rusty. We had several rooms with a pair of real-time translators. I presented the following:
- Software Defined Storage -- Why? What? How?
- The Pendulum Swings Back -- Understanding Converged and Hyperconverged Environments
- IBM Spectrum Scale for File and Object Storage
- IBM Storage integration with OpenStack
- Introduction to IBM Cloud Object Storage System and its Applications (powered by Cleversafe)
- IBM's Cloud Storage Options
All of my sessions were well received, and well attended!
- Pool-side Reception
Photo by Dominique Salomon,
IBM Certified IT Specialist
On Wednesday night, we had a nice pool-side reception. Beers, Caiparinhas, and Caiparoskies. Caiparinhas combine a sugarcane juice-based distilled alcohol called cachaça with muddled limes and added sugar. Caiparoskies combined vodka with muddled kiwi fruit.
(Many of the IBMers from United States skipped this event to get dinner early, so they could then come back in time to watch the third and final US Presidential Debate. Because of the time zone changes, this didn't start til 11:00pm, so they could have easily attended the event and had dinner, with plenty of time to spare!)
There was also a live band! This three part band had two guitarists and one lead singer. The lead singer also did maracas and drums while singing. They covered both English and Portuguese language songs.
- Rodrigo Giaffredo, IBM Engagement Catalyst
Rodrigo gave the closing session. Wearing jeans and sneakers, he reminded me of the casual storytelling style of Jeff Jonas. He organized his stories around four points:
Consider the battle between Twitter vs. Pownce in 2007. Twitter won because it offered better ways to limit what you read, or who you communicate to, through methods like Hashtags, groups, etc.
Henry Ford disrupted transportation. He realized that Time and space is money. However, as he famously said "If I asked people what they wanted, they would have said faster horses!"
Today the challenge is processing data faster. The company that is able to process faster has economic advantage.
Strong ideas focus on user needs. Weak ideas are tactical and features. Consider the [Hippo Roller]. For centuries, African women and children carried water from far away wells either on their hands on or their heads. Much of it would fall out during the long walks. The Hippo Roller holds 90 liters (about 24 gallons) and rolls easily over rough terrain.
Rodrigo showed an graph. On the y-axis was "Importance" and the x-axis "Feasibility". Solutions in the upper right corner are obvious choices. Solutions in the upper left, important but not very feasible, are considered "big bets". Solutions in the lower right, feasible but not very important, he labeled "amenities".
Most designers, architects and developers know that the later the error is found, the more expensive it is to fix. A prototype is worth a thousand meetings.
Take the company Zappos, which sells shoes online over the Internet. The founder, Nick Swinmurn, tried to get investors, getting a typical response: "What are you drinking?" (In USA, we would ask what are you smoking, but this is the way the Brazilians say it.)
With no investors, Nick built a simple website, took pictures of shoes, and fulfilled orders by purchasing the shoes from local San Francisco retailers and shipping them to the clients.
Nick started this in 1999, and finally got some $20 Million USD in funding in 2004. His simple prototype allowed him to focus on post sales support. Zappos was recognized as having the best call center, moving his operations to Las vegas, NV.
Consider the challenges of urban mobility.
Both methods eventually result in a car, but the agile prototypes allow for more effective experimental milestones.
As for Zappos, its prototype proved successful. Amazon acquired them for $1.2 Billion USD in 2009.
It is that simple: Understand, explore, prototype, and evaluate. IBM has adopted "Design Thinking" across its development organizations to better meet the needs of the marketplace.
Overall, it was a delightful event. It is nearly summer down in the Southern hemisphere, so a bit warm and humid. The attendees were all looking forward to a turn-around in the Brazilian economy, and the business opportunities that brings.
technorati tags: Marcelo Porto, Frank Koja, Plenty of Fish, POF, OpenPower, FlashSystem, Blockchain, Everledger, Hybrid Cloud, Mauro Angelo, Systems of Engagement, SoE, SoftLayer, Bluemix, Kenexa, Cognitive Computing, Natural Language Processing, NLP, GPS, IBM Watson, CogniToys, Dino, wearables, Nanotech, big+data, RDBMS, 3D Printing, Internet of Things, IoT, Luis Liguori, digital transformation, Kodak, Samsung, Galaxy Note7, International Monetary Fund, IMF, World Economic Outlook, Leukemia, Black Friday, Software Defined Storage, Converged Systems, Hyperconverged, Spectrum Scale, OpenStack, IBM Cloud Object Storage, Cleversafe, Caiparinhas, Rodrigo Giaffredo, Twitter, Pownce, Henry Ford, Hippo Roller, Zappos
I am presenting a Webinar on Monday, October 31, 1:00pm CDT!
Go to [http://event.on24.com/wcc/r/1286360/BAB1D141B103646D019328D53361D830] website to register!
Modified by TonyPearson
Well it's Tuesday again, and you know what that means? IBM announcements!
Today, IBM announced a few things related to storage.
- IBM Spectrum Copy Data Management
This new member of the IBM Spectrum Storage family helps manage all of those snapshot and FlashCopy images made to support DevOps, data protection, disaster recovery, and Hybrid Cloud computing environments.
The software automates the creation and catalog the copy data on existing storage infrastructure, such as snapshots, vaults, clones, and replicas. This can be especially useful with Oracle, Microsoft SQL server, and other databases that are often copied to support application development, testing, and data protection.
Initially, the following storage devices are supported:
- IBM storage systems running IBM Spectrum Virtualize™ Software V7.3, and later, including IBM SAN Volume Controller, IBM Storwize®, and IBM FlashSystem® V9000
- Storage systems running IBM Spectrum Accelerate™ 11.5.3, and later, including IBM FlashSystem A9000, A9000R, and IBM XIV® and the Supermicro Hyperconverged Appliance
- NetApp and EMC VNX storage systems
For more information, read the [IBM Spectrum Copy Data Management Announcement Letter].
- IBM Security Key Lifecycle Manager (SKLM) V2.7
IBM SKLM is IBM's lead offering for creating and managing encryption keys used by various Flash, Disk, Tape and SAN products.
This software release enhances the separation of duties for better alignment with regulatory requirements, simplifying the administrative access, LDAP integration, and device certificate TrustStore management. Device-group key import and export improves the flexibility in key management across multiple organizations.
For those using Hardware Security Modules [HSM], this software now offers HSM-based backup and restore of the encryption key database.
IBM is also enhancing its support of the Key Management Interoperability Protocol [KMIP], an industry standard to support encryption keys and the products that use them. This release now supports integration with any KMIP-compliant device from any vendor, including the introduction of KMIP Opaque and Suite B profiles.
For more information, read the [IBM IBM Security Key Lifecycle Manager V2.7 Announcement Letter].
- IBM Storage Networking MDS 9000 24/10-port SAN Extension Module
The new MDS 9000 24/10-port SAN Extension Module is supported on MDS 9700 Series Multilayer SAN Fabric Directors. It supports 24 Fibre Channel Ports (auto-negotiating 2/4/8/10/16 Gbps), eight (1/10) GbE Fibre Channel over IP (FCIP) for long-distance replication, and two 40 GbE FCIP ports.
The modules support virtual SAN (VSAN), Hardware-based encryption to help secure sensitive traffic with Internet Protocol Security (IPsec), and hardware-based compression to dramatically enhance performance for both high-speed and low-speed links. This can help reduce costs for long-distance replication over expensive WAN infrastructure.
For more information, read the [IBM Storage Networking MDS 9000 24/10-port SAN Extension Module Announcement Letter].
technorati tags: IBM, Spectrum Storage, Copy Data Management, DevOps, Hybrid Cloud, Oracle, Microsoft SQL, Spectrum Virtualize, SAN Volume Controller, SVC, Storwize, FlashSystem V9000, Spectrum Accelerate, FlashSystem, FlashSystem A9000, FlashSystem A9000R, XIV, Supermicro Hyperconverged Appliance, NetApp, EMC VNX, Security Key Lifecycle Management, SKLM, encryption, LDAP, TrustStore, Hardware Security Module, Key Management Interoperability Protocol, KMIP, KMIP Opaque, MDS 9000, Cisco, FCIP, SAN, VSAN, IPsec
Five years ago, IBM's Watson computer played and beat two humans on the popular American TV show "Jeopardy!" I wrote a series of blog posts about this, the most popular was [IBM Watson -- How to replicate Watson hardware and systems design for your own use in your basement].
Last Sunday, Charlie Rose presented Watson, its progress over the past five years, and the concept of Artificial Intelligence in general, on the TV show "60 Minutes".
Two years ago, the folks at University of Toronto asked me to help their graduate students build a "Watson" running entirely on IBM SoftLayer to see if this would be a worthwhile class project. Needless to say, it was more difficult than they expected, but we managed to pull it off during that summer, able to answer a handful of simple questions from a single page corpus.
Last month, [Industry Leaders Establish Partnership on AI], combining the talents from Amazon, DeepMind/Google, Facebook, IBM and Microsoft, to form a non-profit to explore best practices and ethical questions related to Watson and other Artificial Intelligence applications.
Since data is at the core of any Artificial Intelligence, IBM is pleased to announce today that IBM Cloud Object Storage System is now available on IBM SoftLayer. This is based on the Cleversafe technology IBM acquired last year.
While other cloud service providers have offered data storage in the cloud, this new offering also allows hybrid configurations with geographically dispersed erasure coding. Unlike RAID which protects against the loss of one or two drives, erasure coding can protect against a larger number of concurrent failures. For example, using an Information Dispersal Algorithm of "7+5", where seven pieces of data are encoded on twelve independent disks, the system can lose up to five disk drives without losing any data.
Click graphic to view larger
Combining this with Geographically Dispersed Configuration across three or more sites means that you can lose an entire data center, four of the twelve disks, and still have instant full access to all of your data from eight drives at the other locations. In the graphic, you see two on-premise data centers combined with a third location in IBM SoftLayer.
A recent UBS study determined that [IBM is one of the top four Cloud Service Providers], joining the ranks of Amazon, Google and Microsoft.
This is just another example that IBM's transformation to a Cognitive Solutions and Cloud Platform company is paying off. To learn more, read the [Press Release: IBM Redefines Security, Availability and Economics of Storing Data in the Hybrid Cloud].
technorati tags: IBM, Watson, Jeopardy, 60 Minutes, Charlie Rose, University Toronto, SoftLayer, Google DeepMind, Amazon, Facebook, Microsoft, Artificial Intelligence, IBM Cloud, IBM Cloud Object Storage, Cleversafe, erasure coding, geographically dispersed, UBS, Hybrid Cloud, Cognitive Solutions
Modified by TonyPearson
Today, I met with Teresa Ferraro and Mike Buttrum from FirstRain in their Manhattan office in downtown New York City. IBM recently contracted FirstRain to provide IBMers like myself with analytics on publicly-available news to keep us informed for business meetings. Here's how IBMers can get the most out of this service.
Basically, FirstRain takes a list and generates the best summaries of publicly-available news that are most relevant. You can organize into different channels. Here I have seven channels.
Companies to watch refer to existing or prospective clients that I plan to be talking with soon. Some of my colleagues are assigned to specific clients, so they can set this up once and enjoy the news for the rest of the year. I, on the other hand, meet with different clients every week, so I will be updating this list on a frequent basis.
I have divided the Competitors between major ones, and smaller startups. Since I am often working with business partners and distributors, I made that a separate channel as well.
For product lines, I picked three: Data migration, Data storage solutions, and Software defined storage.
For conferences where I don't know which companies will attend, such as the IBM Technical University, I can set up information by territory. Here is one for Brazil.
I also attend industry-oriented events, so I can pick those vertical markets that might be helpful with dinner conversations. In this example, I chose Energy, Electric Utilities and Gas Utilities.
Once you have your channels configured, you get your results in various sections:
Management Changes lists any changes in top C-level positions, who left the company, who got recently hired.
Key Developments indicates news like mergers and acquisitions and government regulations.
First Reads prioritizes the top six articles for your channel. You can access more, but these six will get you started as you have your morning coffee.
First Tweets gives you the six most relevant tweets, if those articles above were just "TL;DR"
A section on Business Influencers and Market Drivers is interesting to see who the big players are, and what topics are driving the most conversation. Here's an example from my Energy/Electric/Gas channel:
The Most Talked About section covers quotes and commentary about the most talked about companies in your channel.
With most news sources focused on politics, weather and celebrity gossip, it is nice to have a quicker, more focused approach to get the news I need to prepare for my client briefings. Special thanks to my hosts Teresa and Mike for their hospitality!
technorati tags: IBM, FirstRain, Analytics, Newsfeed
This week, I am in Las Vegas for [Edge 2016], IBM's Premiere IT Infrastructure conference of the year.
Day 4, the last day of the conference, is only a partial day, and many people opted to leave on Wednesday evening, or Thursday morning instead. The breakfast and lunch meals had fewer people than the previous days. Here is my recap of day 4 Thursday breakout sessions.
- Building Hyperconverged Infrastructure for Next-Generation Workloads
Marc The'berge from Supermicro presented details of the [Supermicro Hyperconverged Appliance with IBM Spectrum Accelerate]. Supermicro offers three standard configurations, small (114 TB), medium (186 TB), and large (330 TB).
Supermicro is more than happy to customize these, upgrading the CPU, RAM, disk or networking connectivity as needed. This solution is roughly half the price of Nutanix, and offers a better Next-Business-Day/9am-to-5pm support package .
- IBM's Cloud Storage Options
The last time I was in Las Vegas, I presented this topic at [IBM Interconnect conference]. Back then, I was given only 20 minutes, was placed on the Solutions Expo showroom floor, competing with the noise and traffic of attendees going to lunch.
This time, it was much better, a large room, and a bigger-than-expected audience given that it was scheduled on Thursday morning.
Cloud storage comes in four flavors: persistent, ephemeral, hosted, and reference. The first two I refer to as "Storage for the Computer Cloud" and the latter two I refer to as "Storage as the Storage Cloud".
I also explained the differences between block, file and object access, and why different Cloud storage types use different access methods. I wrapped up the session covering the various storage solutions that IBM offers for all four Cloud Storage types.
- IBM Storwize and IBM FlashSystem with VersaStack versus NetApp FlexPod
Norm Patten, part of the IBM Competitive Project Office Storage Team, presented a competitive comparison between VersaStack with IBM storage, versus FlexPod with NetApp storage.
This session was under NDA, so I can't blog about any of the details. As they say, ["What Happens in Vegas, Stays in Vegas"]
- SALSA: The Secret Sauce enabling IBM Spectrum Accelerate on Low-cost Commodity SSDs
Nikolas Ioannou, Research Staff Member for Cloud Storage and Security at IBM Zurich, presented. Last year, Nikolas and his colleagues published a technical research whitepaper titled [Software Log-Structured Array (SALSA) -- A unified stack for SSDs and SMR disks].
Commodity Solid State Drives (SSD) and Shingled Magnetic Recording [SMR] offer low-cost, high-capacity storage.
However, they have their own set of problems, so IBM is developing software that can be included in IBM Spectrum Accelerate, Spectrum Scale, and Spectrum Virtualize to optimize their utility.
The concept of Log-Structured Array has been around since 1988. The IBM RAMAC Virtual Array back in the 1990s used it. NetApp's Write-Anywhere File System (WAFL) is an implementation of the [Log-Structured File System] general concept.
SALSA combines Log-Structured Array with enhancements borrowed from the IBM FlashSystem design, that I covered in my Monday and Wednesday presentations, to enhance write endurance by as much as 4.6 times!
This was an NDA session, so I cannot blog any of the details.
- World-class Flash-optimized Data Reduction and Efficiency with IBM FlashSystem A9000 and A9000R
Tomer Carmeli, IBM Offering Manager for the A9000 and A9000R presented. He presented an overview of these models on Monday, so this session was focused on the data footprint reduction technologies.
Basically, it is a three step process. First, all "standard patterns" are removed. IBM has identified some 260 standard patterns that are 8KB in length, such as all zeros, all ones, or all spaces, and replaces these blocks immediately with a pattern token.
Second, [SHA-1] 20-byte hash codes are computed on 8KB pieces on a rolling 4KB alignment boundary. In other words, if a 64KB block of data is written, bytes 0-to-8KB are hashed an compared to existing hash codes. If no match, then bites 4KB-to-12KB are hashed, and so on. This approach nearly doubles the likelihood of finding duplicates. When a block match is found, the algorithm can replacing them with pointer and reference count.
Third, any unique data that still remains is compressed using Lempel-Ziv algorithm. This is done using the [Intel® QuickAssist]. This co-processor can compress data 20 times faster than software algorithms running on general-purpose x86 processors.
Do you want an estimate of how much "reduction ratio" you may achieve? IBM has developed two estimator tools to help. The first tool is a complete scan for data expected to be dedupe-friendly. It is a slow process, taking 8 hours per TB. This would be ideal for Virtual Desktop Infrastructure or backup copies.
The second tool is the infamous [Comprestimator] that IBM has had for awhile to help estimate compression savings for IBM Spectrum Virtualize storage solutions like SVC, Storwize and FlashSystem V9000. This tool is very fast, looking at only a statistically-valid subset of the data.
The results of both tools are merged, and the result is within five percent accuracy. This allows IBM to offer guidance on which data to place on these new A9000 and A9000R models, as well as offer a "reduction ratio" guarantee.
A client asked me why I bother to attend other sessions, when I probably know most of the material they present. I explained that I can always learn from others. I can honestly say that I learned something new and useful at every session I attended.
technorati tags: IBM, #IBMedge, #IBMstorage, #IBMSystems, Hyperconverged Systems, Marc The'berge, Supermicro, Supermicro Hyperconverged Appliance, Spectrum Accelerate, IBM Cloud, Cloud Storage, Norm Patten, VersaStack, FlashSystem, Storwize, FlexPod, NetApp, Tomer+Carmeli, FlashSystem A9000, FlashSystem A9000R, SHA-1, Lempel-Ziv, QuickAssist, Comprestimator