Zingography # 13 : Cognitive Behaviour + Data Science ; AB Test Validation Tool

I have been really fascinated by the capability of AB Testing Tool to make Designing Decisions using Data Science.
If you combine Machine Learning & Statistical Science to the same – then Previous Combo becomes more Potent & Effective.

AB Testing can be a tough Art to Master, even the most experienced ones go wrong all the time with their hypothesis & metrics selection.
Hence accepting your own & your colleagues varying opinions + navigating through the same to get most effective Long Term Impacts is they Key for Success.
But one should be honest to the science of AB Testing & how it is designed even if results are not favourable – it’s like a daily routine that should be practiced as it is.

What am here to discuss is the New Art of combining “Cognitive Design Behaviour with Data Science Algorithms” and especially use Spotify’s Playlist Recommendation for the same.

My Current Research Analysis says that Spotify’s Recommendation Engine is one of the best in this space!

Yeah better than Apple‘s iTunes, Alibaba‘s + Amazon’s Return HomePage Pages Recommendations or Similar SKU suggestions, Google‘s Search Engine or Google News Feed, Netflix‘s Similar Shows Features. What makes Spotify shine here is how it has used the Music Preferences Attributes along with Human Emotion Capture Calculations ! They use a unique score assigned to each song preferences & suggest them if your attributes matches the range of moods/preferences! Also their Engine is constantly improving & updating based on bigger cluster preferences. What I appreciate is that they are not using Other Platforms similar data but trusting self engines to contribute. Secondly, it empowers the customers to play with the algorithm to change preferences.

This slideshow requires JavaScript.

As per further search, AB Testing plays a very important role in making below decisions:

  • UI Decisions : Button Shape, Contrast colour, Position, Text, Headline, Icons (+ vs Heart), Widget Decisions, Hamburger Menu
  • Page Format – list view vs card view, the information architecture, number of information shared in a single page view
  • Metrics selection & Order Prioritisation for Making recommendations of Playlist
  • Deciding the Weightage of different Key Factors for engine’s Logic – which is the Highlight of Spotify’s Success!

  • Localising + Personalising the Site : https://www.thinkwithgoogle.com/intl/en-gb/success-stories/how-spotify-increased-premium-subscriptions-using-google-optimize-360/
  • Optimising the Keywords Search : When users in Germany searched for “audiobook” and clicked on one of Spotify’s ads, they were either brought to the custom page or to the original page.
  • Creating Culture of Experimentation & Real Time AB Testing Result platform which is most crucial. (They were earlier using Google’s Optimizely for a long time)

Did I ever share the perfect method of conducting an AB Test Experiment :

  1. Define the Problem – To increase conversion, to increase revenue
  2. Come up with a series of ideas to work around the same basis historical data, recent findings, industry insights – This should be a collective + collaborative process wherein everyone should be heard & allowed to explain their logic. Also while prospecting, one has to think about the impact % on success metrics with what confidence, duration, sample size.  Do not hesitate to use AB Testing calculator for same.
  3. Finally one has to prioritise these ideas basis their impact, time + effort + cost and decide on the order of these tests
  4. While designing the test – decide the Hypothesis that by doing so & so the impact shall increase. What is important to note is that while choosing these tests – they have to be such that can be proven only by data results. Also for tests with drastically different options – it can be a short duration test while for closer options, sample size hence duration has to be longer.
  5. So Hypothesis, success metric, options selection are very crucial aspects of the test
  6. Keep observing the performance of key metrics (Primary, Secondary at least) during the tests – no need to take sudden decisions basis this but observe the pattern.
  7. Let the test complete & observe the results – if results are drastically different, you have a clear winner. If test results are negative (do not worry), try with a different hypothesis & options. If test results are closer then decide whether to increase sample size or to discard the test or to go ahead with partial winner (last one not recommended but call can be taken depending on experience/circumstance/influence of other tests).
  8. Keep doing the same for different cases
Advertisements

Zingography 11 : Cognitive Abilities in PM

Cognitive Science involves linguistics, psychology, artificial intelligence, philosophy, neuroscience and anthropology. My learning & experience says that if we are able to include Cognitive Science into our Product Management Process – they results shall be much more refined, Long term & closest to objective.

Cognitive Science has to include multiple stakeholders views from :

  • Customers perspective
  • Team management perspective
  • Leadership & changing Business Landscape perspective

Am quite sure of developing successful models around the same for different PM Cycle stages & this is my effort for the same.

Below are the key PM Stages & recommended Models for the same :

  1. Business Strategy Roadmap based on Market Research & Secondary Research Data Insights — Model 1 (Leadership Management + Market Analysis – BCG Matrix, PLC, 7S Framework, Value Chain)
  2. Need Gap Analysis Identification — Model 2 (STP + 5Porters Forces)
  3. Recommendation Solutions & Prioritisation of Features (New & Enhancements) – Model 3 (Phase Gate Model/ Spider Mapping Technique ; High & Low Impact)
  4. User Persona Identification – Model 4 (Demography & Behaviour (Tech & Products) Mapping)
  5. Roadmapping + Project Management – Model 5 (Gantt Chart)
  6. BRD/ PRD – Model 6 (Process Note, Unified Modelling Language)
  7. MVP Approach – Model 7 (User – Action – Story ; Pain – Gain)
  8. User Journeys/Scenarios mapping – Model 8 (Decision Tree)
  9. Designing-> with quick dipsticks & quick changes around suggestions Model 9 : Neurological Emotional Branding + Decision of buying

Screenshot 2019-03-07 at 8.25.22 PM

10. Development/Middleware – Library & its adaptations for agile expansion
11. UAT all scenarios/Hackathon (Model 10) /CUG – AB Testing Hypothesis linked to Data          Mining & Big Data Analysis…. Statistics & its variance test analysis! Frequentist vs              Bayesian ..
12. Success Metrics formulation (Model 11) Data visualisation /K Nearest neighbours/              Regression/Clustering ; Random Forests; Time series/sequence; text mining!
13. Launch & Optimise
14. Team Management Model

Disclaimer : My suggestions are based on my experience, research, interactions with other companies & my own theories/understandings on this space. Am quite confident of their inter-relationship with each other.

Some Books I recommend in this regard are :

  • Design of everyday Life
  • Sapiens
  • Art of Deduction
  • Tao Te Ching by Lao Tzu
  • Cognitive Science
  • Psychology of Persuasion
  • Infographica

Emotional Quotient

EQ is a very rare quality in a human being & even a rarer quality in a Successful Leader.

I used to study & try to understand in college, but it’s a different ball game when you appear in work arena & then see how work demands/pressures are to be met with the People/Cultural aspects.

Of course one learns to manage the work demands & skill demands depending on one’s capacity. It’s always the people skill management that is the trickiest to master as it is very dynamic, variable to unpredictability.

I struggled with the same as well – majorly because there were a lot of aspects about myself that I had not explored or made myself aware e.g. how I respond to pressure, to a New team person, to a vendor, etc. Since I had not given them any thoughts consciously, mastering them was a far away task.

I think – till the age of 28, and 5 years of work experience – the effort was more or less optimise/adjust for survival and observe around. But I think it was during my 6th year of work experience, in 2015 when I decided to do a proper analysis & self haul of :

  1. Who i am?

  2. What do i want in life?

  3. What do I want in work life?

  4. What I need to do achieve 2 & 3?

This gave a lot of perspective & a lot of peace to myself as I then felt am moving in life with some sort of direction (not 100% clear but still some LIGHT). This made a lot of people interactions & my senior leadership alignments easier as well. I won’t say that it has been absolutely smooth sailing since then but still the choppy waters have seemed manageable & the belief to be able to make it the shore has grown stronger.

global-economics-effect-emotional-4-228-g001

Of course, the presence of my last manager & a few other leaders with higher EQ has made me realise even stronger & clearer on what I want in life & am thankful for that. I cannot stress more on the importance on such People focussed Leaders who groom young people & motivate them to achieve what they want in Life. They become life coaches & mentors, role models for them in moments of crisis.

Last week, one of the senior women leaders decided to move out of the company & it made me feel bad beyond what I imagined. Of course in the short span that I got to know her – she came across as an extremely understanding, warm, affectionate and easy to approach (Again rare leadership qualities). The extent to which she understood your position & could advise you accordingly amazed me – High High EQ. The amount of comfort she offered to a non – direct team member speaks volumes on her ability to connect. The fact that it wells up my eyes every time I think about the fact that she could not continue due to family commitments, speaks volumes about her ability to connect & leave a positive mark.
I do wish to be always there in her life & vice versa plus also hope for many more such people in life moving forward to make it worth it!

ZINGOGRAPHY : Tech/Product/UX/Startup Update # 10 – PM ToolKit

Please consider every PM to be a works-person, who needs tools apart from their skills to do a good job out of a situation!

Every worksmith/ carpenter/ chef, etc. is incomplete without their toolbox so its important as a Product Manager to be sure of your own sharpened tools basis your experience, intuition, comfort/compatibility, etc.

I also have now worked for 8+ years in different Products domain starting with Data, OTT, E-commerce, Retail Channels (B2B + B2C), Media, Food, Jewellery, FMCG, FinTech, Travel/OTA, AdTech, Transportation (Cabs/Trucks), etc.
And from my own & other PMs experience – let me share a list which I find is useful for one & all. These are compiled basis checking with other industries & PMs as well :

  1. Research Tools : SurveyMonkey, Google Forms, TypeForm
  2. Current Situation + Need Gap Analysis : Porter’s Frameworks – SWOT, 4P, STP, 5 Porter’s Force
  3. Project Management : Asana, Jira, Trello
  4. Team Management : Slack, Basecamp
  5. MVP & Road-mapping : Asana, Aha, ProdPad,
  6. Spec Writing : Word, DropBox Paper, GitHub
  7. User Scenarios Mapping : Excel, Smaply/StoriesonBoard
  8. Designing : Invision, Iconjar
  9. Coding/ Development : GitHub
  10. UX : Prototype,io, Axure
  11. Team screen sharing + feedback incorporation : Zeplin, Intercom
  12. AB Testing : VWO, Wasabi
  13. Analytics – Front End : Google Analytics, Firebase
  14. Analytics – Middle ware : Moengage, Clevertap, Appsflyer
  15. Analytics – Back End : SQL, ML Tools
  16. Campaign Management : Adobe 360
  17. Targeted Campaigns : Targetting
  18. Revenue + P&L Management : MS Excel Macro

Apart From this – the must have ingredient almost like Oiling is 5-6 hours of Reading, Networking, Experimenting, Failing, Sharing, etc.

All The Best : Let the Magic Begin!

10x10FT-wiece-Ksi-ki-P-ki-Biblioteki-Pok-j-Czaszka-Halloween-Klienta-Fotografia-T-o-Studio

Listen & Understand..!

Listening is an important skill….

It doesn’t only happen with ears but with eyes, mind & body touch as well..!

Perhaps listening by eyes is the most important one – since they don’t lie. It is difficult to falsify what one sees from one’s own eyes – about surroundings as well as of others & if you can see through someone’s eyes then there is nothing beyond it.

Yes – learn to listen to be a more compassionate & successful human being in Life in general.

Those who are a well rounded personality & are in general appreciated by all are considered to be excellent with their people management skills & that is because they come across as friendly & compassionate to most of the people around. They tend to listen, understand others latent + expressed needs/wants better & faster and come across as supportive to achieve them.

This is a great skill set – even when talking to your customers, while analysing data of your business, it is important that you are able to connect the dots and able to listen, understand their issues to provide them a solution.

Same applies in relationships – starting with parents, siblings, friends, cousins, companion, spouse, in-laws, children : it is imperative that you listen & understand what is the person wanting to communicate. Where are they coming from & why are they saying that plus what do they exactly want & then how can you give them that basis your self awareness.
Many a times – you can’t abide because of circumstances & your own limitations and there is nothing wrong in being honest about it. In fact, straight forwardness is much appreciated by the mature & upright people & held in high regard when communicated in the right spirit & well within time. In fact the ones who keep people hanging & dilly dallying are not appreciated neither are those who turn their faces back after saying YES.

But here’s one more thing about Listening & Understanding – its a Long Process & Evolving one. One has to actually invest time & energy into it by spending time, observing them, their actions, their interactions with other people, their backgrounds of course, their words & actions, dreams, relationships, etc.
Its like keeping a hawk eye on Stock Market Blue Chips which are your Key Investments – sometimes it happens that a few are not visible with less information available but appear very interesting & worth every penny – I find them the most interesting coz few people will go for it for the effort asked & it can very much be the game changer. I have always gone for the obvious yet elusive – be in terms of choices of clothes, career choices, hobbies, people, etc.

Am sure, it is an evolving journey & I will adapt to grow better plus faster once am able to identify my areas of improvement. Last 1year or so has been a struggle with coming to terms to my feelings, personality & I feel I have taken leaps in terms of learning to be Patient, Perseverant, Humble, Positive despite everything crashing, Being Strong & Cool.
Still I think – I have distance to go in terms of controlling my reactions, feelings, expressing my needs, wants to those around me in a much more effective & acceptable way.

  • The expression whenever it comes (let it come to the last possible in peace or conflict after understanding situation & all perspectives) has to be straight forward – without any drama & iota of doubt, straight forwardly as possible. Learn to control your wants/ desires for some other good time – what is Right or Good for all will Happen any which ways! You are too small a being – remember in a world outside your being. You can control your inside world & never what happens to you or what happens to others around you.
  • Similarly, others views/ feedbacks are to be taken with the same feeling of it being their perspective – filter it out to sensible stuff while leaving the rest of it.
  • Learn to be consistent in all situations – good or bad, outside or inside, home or at work. That way you are self aware & in touch with yourself all the time & their is no conflict of personalities & thoughts. You shall be much more at peace with yourself.
  • Be Loving, considerate more & more towards others & always bring the +ve feelings first even in case of conflict – YES, IT HELPS & ITS THE RIGHT WAY. Be compassionate towards others issues, challenges, situations.

These shall be good points to kick off your remaining part of the year & build your personal or work lives! Get Going!

ZINGOGRAPHY : Tech/Product/UX/Startup Update # 9

AB Testing is a Cultural & Personal Choice

Ittakes a lot number of weeks of research into white papers of statistics, informative articles on application, Live blogs for examples hunting, speaking to relevant stakeholders in competition & outside companies to discuss & link it with your current situation & problem statements to finally conform on your Approach.

I did the same with AB Testing!

And in all fairness, I have to admit that this has to be one of the most Surreal experiences since I realised there was a missing piece I was not including in the whole Picture/Frame/Painting of Product Design Thought Process.

AB Testing is critical to make your Product/Campaigns/Analytics/ Development Decision making simple & obvious decision making come out with an astounding clarity once AB Testing is conducted.
Plus how important it is to be persistent & have patience with the tests (design, conducting, results) — to know when to stop & when to start again.

There are two places where conducting AB Testing is a MUST :

  • Once when the prototypes of your App Key Pages are ready & you must know the initial response to them from your target consumer personas.
  • Second, before doing the campaigns & scaling the features/products — knowing the intricacies details in the form of headline, text, image, theme, colour palette, etc.

A few things must have technical :

  • AB Testing tool —

for beginners : VWO/Optimisely like SaaS tool ;

for mature organisations : Building the capability from scratch

for organisations in between who wish advanced readymade tool — I would recommend the hybrid way by using an open platform like Wasabi which can be customised to your requirements.

  • Good Quality Team with understanding of Statistics, SaaS Tools, Consumer Behavioural Analysis
  • Data Mart/Warehouse with access to Transactional Data as well as Online Behavioural Data with necessary cuts for segmentation basis Business Intelligence

A Few things in terms of Soft Power :

  • Open Mind — ready to question obvious right answers (infact more if they are obvious)
  • Capability to deep dive & look at intrinsic details
  • Collaborate with different teams/people to check if the findings or the direction of the findings are correct — this in my understanding is the most POTENT!

Organisations must insist their people to only come to leaders once they have collaborative evidences to move in a certain direction.

It may so happen that after spending significant time also — you may not come to an conclusive evidence & one should be open & amiable about the same & not push for an evidence for the sake of it.

I must thank quite a few people for the same but most of all Booking.com to highlight that there is something missing in my thought process — the webinar by Lukas was really helpful!

ZINGOGRAPHY : Tech/Product/UX/Startup Update # 8

Today I wish to compare the startup spaces in Indian & European Context. Those who read this should know that I share this majorly for my own clarity & perspective and if it helps others then great!

Recently, I have been focussing on 3 main things apart from my daily work & travel :

  • Reading a lot about new skill sets essential for PM especially like Deep Learning, Data Mining
  • Linking it with my current Work & Profile as well as Future Roles that I wish to do
  • Collaborating it with other PMs in different sectors/industries/companies

And there are some Key Insights regarding Different Geographical Consumer Tech companies that I have concluded :

  • Focus in Indian Companies (Startups as well as Big Ones) is to scale
  • Focus in European Companies is to understand the consumer behaviour first & sync all departments of technology, data, customer service towards that ONE Customer Proposition/their USP which will help them Succeed while focussing less or almost nothing on others
  • In US Companies, they go for massive funding & their aim is that – once establishing a prototype (more or less that with a short term vision)
  • SEA are replicating Chinese models more or less in terms of consumer personas as well as Tech Propositions
  • MENA regions are going like Indian Conglomerates – slow & cautious for the models that are already well proven for success

Let me also talk about a few skills which are becoming redundant as in they are understood that you will have when you apply for Product Roles :

  • Digital Marketing
  • Product Design & Strategy
  • KPI Metrics Management
  • Project Management
  • P&L Ownership
  • Business Development
  • Hiring & Training

These are the new skills towards which you need to show inclination & an aptitude for – please remember that though these may seem new worlds, their nuances are based in subjects well introduced to us. So let me give the picture complete for better understanding :

  • Machine Learning/AI/Deep Learning : Maths, Statistics, Computer Science for Coding
  • Blockchain : Telecom, Communications, System/Server Integration
  • AR/VR : Electronics, Robotics, Graphic Designing
  • 3D Printing : Biotechnology, Engineering Drawing

Personally I enjoy first 3 a lot & keep looking how it can be valuable in my current scope of work!

ZINGOGRAPHY : TECH/PRODUCT/UX/STARTUP UPDATE # 7.5

Sharing my list of most useful Apps (based on popularity, experience, usefulness) :

  • WhatsApp
  • Gmail
  • Twitter
  • Instagram
  • Amazon
  • Google Maps
  • Wikipedia
  • YouTube
  • Facebook
  • LinkedIn

Last two are my least favourite of all – they are just latching around for lack of options!

Will add more in due course.

 

This slideshow requires JavaScript.

There shall be changes in coming years but one has to adapt the learnings from the top performing apps.

Indian Gifts that will shine always #2018

  • YOGA
  • Ayurveda
  • Indian Education System
  • Family Ecosystem
  • Business Culture of the small families, SMEs & SHGs
  • Mahabharat + Ramayan epics
  • Peace – Buddha, Gandhi, Jainism Message
  • Technology Outsourcing yep – The Brain Drain!
  • Strong depth of History & Culture

What India needs to be known for even more :

  • Creating an indigenous model for rural + urban cooperation in health, education, individual spending habits
  • Lost & Found unique examples of Art, culture, food, handicraft, faith, medicinal treatments, astrology, science, maths
  • Unique Business Models like Dabbawala serving masses involving huge labour & connect with upper middle classes
  • Adopting Modernism in Agriculture (yet to happen)
  • Developing models around sanitation, cleanliness, desalination of water, renewable energy, Better Forecast Mechanisms

My Fears for Indian Growth :

  • Money Ownership concentrated to limited HNIs much like Middle East
  • Aspirations & Representations like USA but lack of system might topple them to the other side
  • So far rapid growth & development in manufacturing, electronics, Digital is due to China (aping)
  • Laggardness in promoting Pride & History like Europe
  • Different cultures & variety like SEA & Europe again proving to be a challenge

In reality – India shall grow by a unique model of Govt & a few HNI hand in hand for now. Remaining Pvt bodies as well as SMEs will have to be alot more cooperative to Govt regulations & financial guidelines to ensure the growth is entirely & completely inclusive. Once that happens & penetration of the Good can go deep, growth will automatically happen which I have no doubt about.

Also India & Indians need to understand a few other things :

  • Less spending time on mobile & digital devices
  • More time being spent on exploring & understanding the world + people around you
  • Less spending time & energy & giving less importance to celebrities & entertainment modes or other distracting modes
  • More time being spent on knowing your trueselves & your true potentials
  • Aping others blindly for solutions, inspirations
  • Being independent, fearless, self reliant in true meaning

images

Blog at WordPress.com.

Up ↑