Your Digital Footprint

What is Big Data?

I’ve been working with customer data for over 20 years now. I’ve seen good data, bad data, black data, red data, big data and bigger data.

Big data is not lots and lots of data; well actually it sort of is, but that not all it is.

Big data has 3 components. These three components must provide value and insight to the user.

Let me explain…

A group of data programming geeks were consulting on site for a large airplane manufacture. They were creating a large data warehouse to store all sorts of details about a planes engine, parts and maintenance details. Each part was to be tracked and available for complex queries. It is big data but it is not Big Data, yet.

A lot of information is collected regarding an aircraft. Mandatory maintenance schedules and updates are recorded. All maintenance (scheduled or unscheduled) must be recorded, commercial and private. This is not a requirement for cars/trucks; cars don’t fall from the sky, yet.

Side Note: Should autonomous cars have mandatory maintenance schedule to be used? Like an aircraft? For example a check point for the vehicle may be required to be road worthy a scheduled intervals.

With tons of data being entered into storage, where to you begin? This is new data to the user, there needs to be exploration to find new patterns that provide insight to decision making. Add lots of information together, so that it is accessible to ask ‘what if’, ‘when if’, ‘why if’… and answering that question is BIG DATA

The geeks, analysts, programmers had already defined that an unscheduled repair is 1000x more costly than a scheduled repair. A well known statistic in transportation. What what can you do about it? How do you find new scheduled repairs that prevent costly unscheduled repairs? Using the data to define benefit or advantage is BIG DATA.

BTW – you don’ t need lots of data to have Big Data. Just Big Value.

Weather forecasts are a user of Big Data. The weather data points have been recorded for centuries. We have applied analytics to this data to create weather forecasts (aka predictive analytics). Weather forecast are a result of Big Data – using history to find patterns to forecast the weather.

Big Data can come from all sorts of sources.

You can see from the chart below ‘every minute of the day’, we as individuals create tons of social data every time we use social apps.

domo-data-never-sleeps-30-600x954 — Amount of data captured every minute.

Data is not just created by website searches; is also also created every-time we take a digital picture, a doctor scans a patient on digital film, or a Fitbit collecting steps. This is new data that didn’t exist so long ago.

Side Note: There were pedometers when I was a child. They measured your steps the same way, by movement. Today ‘Fitbits’ are a rebirth of an old tool. The ability to report and share your metrics changed the industry.

If you are digital health geek, you create your own Big Data. Tracking your vitals, exercise, food intake and sleep patterns, gives you insight into goals.

What is the Invisible Net, Deep Web or Deep Net?

Today’s search engines, like Google are made for regular, everyday answer seekers. If you want to know about boats, whether big or small, they work well.

The Invisible Net (Deep Web or Deep Net) refers to content that is stored in databases accessible on the internet but not through search engines. For one reason or another it cannot be indexed by conventional search engines. The only way to access the information is to search the databases and web services themselves.

Before you try to access information on the Invisible Net, you may want to do a practice run. Various sites collect databases on the Invisible Net. For instance, as a card-carrying library user, I can my online library to access at least a dozen databases that I wouldn’t be able to get without it. I bet your library has much the same. I’ve told you before I ♥ my library.

Internet-research challenged? Many libraries and community colleges have free or inexpensive classes on how to use the Internet. You’ll find one offered by ed2go called “Research for Writers.” It’s excellent.

Home devices and your digital data.

NOTE – there is no way I can list every device that collects data in your home. But I’ll list the ones I use. You can add or delete to your list.

A digital device is one that has memory, via hardware/software. The memory can be local/internal or connect to external services via wi-fi, blue tooth, etc.

Data stored can be all sorts of information. From how often it is on to what settings. Something simple would be your home thermostat. If it may have connected to a website or mobile app.

My iPhone. Any smart phone.
My iPad. Any tablets, game consoles, laptops.
AT&T Digital life – aka my alarm system. Depending on the various components connected to your system, it knows when you are home, how often you leave the house. Commonly used doors and windows.
- Don’t let your guard. The alarm system is for my physical wellbeing. Which has a digital component, a website and app. So I only have cameras on the outside of the house. I also keep a sticker over my cameras on my MAC, laptop and tablets.
At&T internet and cable TV, And all streaming entertainment (Hulu, Netflix, YouTube). They know when you are watching, how long you are watching, what time you are watching, type of device you are using.
- There are some viewing devices that use voice commands and motion sensor, and would be able to determine when the room is occupied and the activities.
My Buick and OnStar. Besides the GPS information, where you go, how often and when, your vehicle’s diagnostics system collects; tire pressures and other engine conditions.
Alexa (aka Echo). This devices is always on and listening. FYI – all request you make to Alexa are captured in history within the Echo app (accessed online). Echo is an Amazon product, marring online shopping and at home activity into an individual’s profile.
GoPro and other digital cameras/videos. Time and location are stored in the memory with the photos. A camera that uses 35 mm film may have some memory within the camera software itself.
Printers. Did you know that trapped deep in the printer memory is a copy of everything that has been scanned and printed. There is a tiny memory chip that compresses the files to achieve. This chip allows the system to recall the last X copies and other fun features.
FitBit and other health monitors.
Craftsman Garage Opener. Wireless keypad and accessible via mobile app.
Roku
Wii and other gaming consoles.

That is a good list, considering I claim to be low tech (maybe I’m medium tech). I’m not an early adopter, but I am curious. It takes me time to commit to purchasing new tech gadget, but I do have a collection of digital devices.

You may have a baby monitor, automatic vacuum, anything that connects to a mobile app, website or router.

The power behind Amazon

Amazon.com is an example of a business whose primary assets are its databases. Amazon has advertised itself as Earth’s largest bookstore, based on the millions of books they list in their database. Amazon also sells a variety of other products from music CDs to lawnmowers. The database keeps track of source inventory levels and processes sales transactions.

Another Amazon distinctive is the amount of information it keeps on its customers. In addition to the usual name and address information, Amazon keeps track of what products customers have bought in the past, and even of what they have shown an interest in but not bought. With this information, they automatically construct a profile of each customer.

Whenever a repeat customer visits the Amazon site, a personalized screen appears that advertises products they are most likely to buy, based on the preferences indicated by their profile. This profile is stored in a database, which is updated every time a customer returns to the site. Each return to the Amazon Web site, offers new recommendations specifically targeted to the customer.

Now add al that information to the 1 million Echo households in the U.S. And how that data becomes a valuable assets for any company.

Autonomous vehicles

When you think about an autonomous car what do you picture in your mind? Something like the Jetsons or KITT form Knight Rider. When we talk to our friends and co-workers about autonomous cars – the conversation gets heated. Some against it, are for it, some think they will never see it happen. What does autonomous really mean? Automated? Self-driving? Handsfree? Does it pick up your Starbucks before you?

Well we know autonomous cars are vehicles that are capable of sensing its environment and navigating without human input. And I believe the number one selling point for an autonomous car is the safety factors. But I’m still not sold that in my near life time (2020/2025) there will be 100% autonomous communities. We have different ideas of what to expect out of autonomous and transportation. My vision is more like the Jetsons. Flies through the air and is quick.

Are you thinking about how an autonomous car would affect your life?

Changes to our neighborhoods:

What happens to our garage attached to our house? Parking structures and handicap parking spaces?
Are they fuel efficient & environmentally friendly?
Do they just appear and dis-appear as needed?
Does it eliminate Valet parking?
Are they self charging?
Truck drivers?

Vehicle Ownership

Does everyone car-share?
Can an average individual afford their own autonomous vehicle?
Will there be as much as an emphases on customization of vehicles?
Will it create value in the collector cars – ie ’66 vet?

Respondents to an independent survey were found to be most concerned about software hacking/misuse, and were also concerned about legal issues and safety.

Sensors and data will play a part in the infrastructure designed for autonomous cars. 2012, Computer scientists at the University of Texas in Austin began developing smart intersections designed for autonomous cars. The intersections will have no traffic lights and no stop signs, instead using computer programs that will communicate directly with each car on the road.

But even after all the technology is built, we have rules that conflicts with innovation. The Vienna Convention on Road Traffic This international treaty, designed to facilitate international road traffic and increase road safety, was agreed upon at the United Nations Economic and Social Council’s Conference on Road Traffic in 1968 and came into force on May 21, 1977 (http://www.unece.org/trans/conventn/ crt1968e.pdf). The convention states that “Every driver shall at all times be able to control his vehicle,” which conflicts somewhat with the automatic control concept. Systems such as antilock braking systems or electronic stability programs are acceptable because they do not take full control of the vehicle but rather help the driver to follow a desired path, possibly in situations where control of the vehicle has already been lost. Wider use of technological advances, however, will require amendment of the convention.

Happy Summer 2016. I’ve been spending it at the library.

Sorry I haven’t been around for a while. I promise it is for the best. I’ve enrolled in a bunch of classes on building websites, blogging and databases.

Even after years of customer data and marketing technology projects, I’m still confused on some of the basics of website development and social media. The classes I’ve been participating in are all geared to help me move forward with particular skill sets. Bring you a better user experience on my site.

A lesson learned this summer: I rediscovered my library. It took me years to convert to digital books, around 2013. My eyes didn’t adjust easily. But for the last 3 years I’ve been reading 90% digital. Now with Alexa/Echo and Audibles I began exploring what my digital library has to offer me again. They have access to a variety of digital content – college level classes, books on audible. And my library has converted a lot of the space once storing heavy hard covered books into work spaces and offices supporting 2 to 200 people, equipped with projectors and white boards. I even took a Texas holdem poker class at the library a couple of weekends ago, it was fun.

I’ve been considering hosting a class at the library myself, for some of the question I get asked by friends ‘my parent’s age’. They are on their second iPhone, have grandkids, and still don’t know how to use FaceTime. My mom who still can’t create an email by starting from new email (only because my 8 year old nephew hasn’t had a need), loves FaceTime, but still doesn’t know why it only works with certain people. My parents just got an Echo. My 8 year nephew my have something to do with that, he thinks of my Echo as a friend. Here you have 72 year old grandparents learning personal technology from an 8 year old. It may provide some interesting ideas for future posts.

EXTRA! EXTRA! Read all about it! Digital, on-demand, real-time not your typical newspaper.

If you are my age or older, there was a time you used the newspaper as a source of information. You saved clippings. Read the funnies. A weeks worth of unread papers had it’s own special place in your home. You may have even had a paper route as a teenager – I did.

If you don’t know what a paper route is, it was a job most teenagers could handle. You got paid for each paper you delivered. The more papers you delivered they more you earned. It was a direct income job. You managed subscriptions, collected payment and managed your supply chain. You owned a route, usually in your own neighborhood. The first paper route I had was a daily newspaper. 7 days a week, everyday of the year including all holidays and bad weather. The second route I had was the Observer, which was only published twice a week. And if you don’t know what a newspaper is you are young.

My 8 year old nephew was recently grounded from the TV and other electronic devices. He is very passionate about his sport scores, stats and updates. Not just who won the game but his is interested in the details. It was killing him not to know how the game when last night. So we purchased a newspaper and an ice cream cone and we read the paper together. This was the first time he had seen the sports section of a national daily printed newspaper. He was surprised to see the stats and scores laid out on this huge piece of paper in black and white. He didn’t’ really know what a newspaper was or what information was available. My nephew’s generation has not yet been named but it will be a generation without the printed press. He is growing up in a culture of always digital, on-demand and real-time.

Continue reading EXTRA! EXTRA! Read all about it! Digital, on-demand, real-time not your typical newspaper.

Do you manage your own personal data?

We often talk about how the data is used or could be used. We argue about the sensitivity of when data becomes so detailed it becomes ‘stalking’. We hurry to move past the introduction of the ‘terms and conditions’ just to get the app, the game, the connection. We hear a lot about identity hacking and stolen personal information. We talk a lot about keeping your data safe. Your network secured.

So their customer data is your data, data collected about you. Your likes, your behaviors, your preferences, your triggers, your digital footprint. Not only is it used to keep you safe, it is used to predict the future. But what happens when you are ‘done’ with the equipment or vehicle, is your mile by mile driving history in someone else’s hand? I want to talk to you about these things, from our perspective. Not from the perspective of customer data, but from mine and yours – personal information. Who controls it? – you know who controls your finance and money, why not your own personal information.

There are rules and laws that companies must be transparent in their terms and conditions. They have to be clear on how to opt out or into communications. But each channel has different rules and even the largest of companies haven’t figured out how to manage the communications across their business units. Making it necessary for you to manage multiple user ids and passwords. Is a digital wallet easy and safe? I want to have open conversations with you on what information exchange is happening between you and the information about you.

What information is aggregated and what is uniquely tied to you as an individual.

WHAT MAKES YOU UNIQUE

When you give an email with an online order, what happens to the email information? What are the rules? I think if more individuals know what to expect, and how to turn off ‘unwanted’ emails and exchange or their own contact details, and the companies are forced to oblige then we can really make the system work for us – the individual.

I like to think this is a conversation between my friends and family and myself. I want people to know what options are out there, what to do with personal digital content

Our digital world is running at lightning speed. This change in our ecosystem has us opting in and out, for what? Our digital world gives us wearables, vehicles and smart homes. All the same time it is collecting and measuring inputs and outputs. I want individuals to understand the laws and how these companies are ‘allowed’ to store and use it.

Credit Card Charges – Part I

money on trees — Balancing your credit card statement

Not many people balance their credit card statements. (Not sure who balances their checkbook today, besides my mom – she says it is therapeutic?!??!) I have always given my credit card statements a quick glance, looking for charges I didn’t make. But recently I met someone who religiously balances his charge statements, in a course of one year, he found approximately $500 in overcharges, not in his favor. (Oh, of course there were some charges that were in his favor – he didn’t bother to correct these.)

So I started watching my credit card charges more carefully. Here are the 3 mistakes I caught in 3 months:

Continue reading Credit Card Charges – Part I

Echo – my newest gadget

I’m not sure what exactly sparked my interest in Echo. I was listening to a podcast where the host was bragging about the thing. And then my Jawbone speaker started acting up. I’m already an Amazon Prime customer, so I went for it (without any deep research into the product).

What is an Echo? It is not as helpful as Rosie Jetson, but it can tell a joke when you ask. Echo is a gadget similar to a smart watch but for your house. She responds to the name Alexa, and responds to your verbal questions (I say she – because it is a women’s voice and a female name). It looks like a small speaker. A little bit Siri, Google, and a Radio. It is hands free, you can shout out commands (or just ask politely) as you move from room to room in your house (Alexa order soap; Alexa set timer for 5 minutes). It is an Amazon product and has a lot of features that you find on Amazon. You can order, buy and have delivered any product from Amazon. (Alexa, ‘order my dishsoap’. A couple of ‘yes’ confirmations and your Amazon box will arrive on your porch.)

I do have a couple of disappointments regarding the Echo. First the marketing material was too grand and general (connects to any smart home devices – ‘any’ has been misused.) Second all the help and how-tos are tucked in the Echo product page on Amazon shopping site, most of the information is a sales pitch and not detailed owner instructions. and there is not a lot of information available. Ironically some of the information is found in the Alexa app – but you have to have a Echo otherwise why would you need the app.

Here are some of my thoughts on Echo:

The number of devices compatible with Echo are still limited. Most of the equipment I already own are non-compatible. I currently use a Comcast security system, which includes the thermostat and lights. It would nice to be able to use the Echo voice control for these setting or even play the security notifications through the Echo speaker.
Past tech conferences and journalist have discussed the end-less possibilities of integration. But a lot of the cool features are still in the works. I guess I still have to use my mobile app to start my car in the morning. Maybe when Echo is a little older she will be able to start the car.
I currently use Apple products at home. Echo connects your Google accounts for calendars and reminders. And that is the only calendar Echo connects to. So I now have to either start using Google calendar on my Apple devices. Or to use the Echo for my personal scheduling and reminders.
Echo is a household item, it does not recognize different voices or preferences. Everyone is equal, including company.
You can not talk on the phone using Echo as your Bluetooth receiver.
Echo will not read your incoming text to you.
Echo cannot read horoscopes. Not everything you ask on Google is available on Echo. Similar to mobile apps someone has to develop the app for Echo to so something (like search and read horoscopes) and then you have to download (install) that to your Echo. There will be lots of young developers (and maybe older) playing in this space. Providing joke apps, affirmation apps, recaps.
- Although we have this information available via an internet browser, Echo has to convert it from Text to Speech. The search results on a web page might be too ‘tangled’ for a machine to find the right content and ‘read’.
You can not ask Echo about Echo. It does not support questions regarding its own tech help. For example if you ask: ‘how do you connect a new device?’ Answer: I do not know who to answer that question.
It does record every question and answer you ask it. And on your Echo app (or Alexa App) you can rate the response. I’m confident this data is being captured and mined for machine learning.
Echo is learning and adding all the time. Last week they announced the integration of Domino’s and Uber. Unfortunately, I only order pizza about twice a year and not from Domino’s. And well in the D, we tend to be attached to our vehicles, so it will be a long while before I become a regular home pickup Uber user. I’m sure there will be a new feature for me to use soon.

There are a lot of possibilities and apps for Echo, they are just not yet integrated into the software yet. Echo should be able to control my garage door (Craftsman), adjust my thermostat (Comcast) or even remote start my car (OnStar) via my Echo.

Echo is part of the whole environment of Internet of Things (IoT), as well as Craftsman, Comcast and OnStar. They all produce products that are controlled digital as long as you have an internet connection. And basically anything that can be connected or powered by a (mobile) app – should be able to receive commands from Echo.

You send a voice command to Echo. Echo connects to the IoT and access the digital app that controls the garage opener. This sends a command to open/close the door. To remotely access the garage opener, it will require you to set up your accounts and logins for the applications. And along with this convenience we open digital data to be vulnerability.

As for the developers on this product, they have a so many products to connect to Echo. The list may have them working for decades. And I don’t think this technology will go out of style soon. Yes, robotics are on the rise and there will be moving smart things in our homes (beyond Roomba). But right now I’m happy with Echo has my home command center and I’m happy to get easy access to updated news stories, weather reports and scores without having to sit at the computer (or tablet) and open an app or browser.