Showing posts with label Big Data Advisory. Show all posts
Showing posts with label Big Data Advisory. Show all posts

Tuesday, 25 December 2018

Mastech InfoTrellis - Experts in Big Data Analytics

Mastech InfoTrellis’ diverse expertise in the Big Data space, has helped to assist global enterprises in their Big Data initiatives

Big Data Analytics Hub

Mastech InfoTrellis offers managed Big Data Analytics Hub Solution Centered on Hadoop, which enables customers to consolidate multi-channel data of various formats into a single source. Big Data Analytics Hub enables self service analytics by different business functions.

AllSight – Customer Intelligence Management

AllSight Customer Intelligence Management System which delivers Enterprise Customer 360 by ingesting structured and unstructured data from disparate data sources across the organization.

IBM Big Data Solutions

IBM Big Data Solutions combine open source Hadoop and Spark for the open enterprise to cost effectively analyze and manage big data. With BigInsights, you spend less time creating an enterprise-ready Hadoop infrastructure, and more time gaining valuable insights. IBM provides a complete solution, including Spark, SQL, Text Analytics and more to scale analytics quickly and easily.

Learn more at http://www.infotrellis.com/big-data/

Monday, 3 December 2018

Big Data Analytics & Data Management Services

Mastech InfoTrellis’ diverse expertise in the Big Data space, has helped to assist global enterprises in their Big Data initiatives

Big Data Analytics Hub
Mastech InfoTrellis offers managed Big Data Analytics Hub Solution Centered on Hadoop, which enables customers to consolidate multi-channel data of various formats into a single source. Big Data Analytics Hub enables self service analytics by different business functions.

AllSight — Customer Intelligence Management
AllSight Customer Intelligence Management System which delivers Enterprise Customer 360 by ingesting structured and unstructured data from disparate data sources across the organization.

IBM Big Data Solutions
IBM Big Data Solutions combine open source Hadoop and Spark for the open enterprise to cost effectively analyze and manage big data. With BigInsights, you spend less time creating an enterprise-ready Hadoop infrastructure, and more time gaining valuable insights. IBM provides a complete solution, including Spark, SQL, Text Analytics and more to scale analytics quickly and easily.

Read full story at http://www.infotrellis.com/big-data/

Tuesday, 24 October 2017

Big Data and Analytics Solutions - Mastech InfoTrellis

Mastech InfoTrellis offers managed Big Data Analytics Hub Solution Centered on Hadoop, which enables customers to consolidate multi-channel data of various formats into a single source. Big Data Analytics Hub enables self service analytics by different business functions.

Big Data and Analytics Solutions - Mastech InfoTrellis
Big Data and Analytics Solutions - Mastech InfoTrellis


IBM Big Data Solutions combine open source Hadoop and Spark for the open enterprise to cost effectively analyze and manage big data. With BigInsights, you spend less time creating an enterprise-ready Hadoop infrastructure, and more time gaining valuable insights. IBM provides a complete solution, including Spark, SQL, Text Analytics and more to scale analytics quickly and easily.

Informatica provides the industry's only end-to-end big data management solution to deliver successful data lakes. Informatica enables you to integrate, govern and secure big data. Informatica’s self-service data preparation and information catalog, role-based tools, and comprehensive metadata management capabilities ensure that big data can be quickly turned into trusted data assets.

A fully managed cloud data warehouse built on big data platform, Amazon Redshift is highly scalable and effectively contributes to improved performance by helping organizations acquire new insights on customers, with optimized costs.

Visit Our website for more information at, http://www.infotrellis.com/big-data/

Tuesday, 17 October 2017

Big Data Analytics Solutions by Mastech InfoTrellis

Mastech InfoTrellis offers best of breed Master Data Management Services enabling Customers to harness the power of their Master Data. Mastech InfoTrellis has successfully delivered Master Data Management Projects time and again over the past decade.

Mastech InfoTrellis’ diverse expertise in the Big Data space, has helped to assist global enterprises in their Big Data initiatives

Mastech InfoTrellis is Premier Data & Analytics Company Specializing in helping Customers to generate Actionable insights From Their Enterprise Data Assets

Over 7 years of resource and process rigor in Data Management and Analytics space

Experienced fast and laser focused implementation team with client success chips on shoulders

Thursday, 12 October 2017

Interesting facts about Mastech InfoTrellis Big Data Analytics Solution

Interesting facts about Mastech InfoTrellis Big Data Analytics Solution
Interesting facts about Mastech InfoTrellis Big Data Analytics Solution
Big data is being generated by everything around us at all times. Every digital process and social media exchange produces it. Systems, sensors and mobile devices transmit it. Big data is arriving from multiple sources at an alarming velocity, volume and variety. To extract meaningful value from big data, you need optimal processing power, analytics capabilities and skills.

Big data is changing the way people within organizations work together. It is creating a culture in which business and IT leaders must join forces to realize value from all data. Insights from big data can enable all employees to make better decisions-deepening customer engagement, optimizing operations, preventing threats and fraud, and capitalizing on new sources of revenue. But escalating demand for insights requires a fundamentally new approach to architecture, tools and practices.

Mastech InfoTrellis offers managed Big Data Analytics Hub Solution Centered on Hadoop, which enables customers to consolidate multi-channel data of various formats into a single source. Big Data Analytics Hub enables self service analytics by different business functions.

Sunday, 10 September 2017

Mastech InfoTrellis - Big Data Management Company

Mastech InfoTrellis’ diverse expertise in the Big Data space, has helped to assist global enterprises in their Big Data initiatives

Mastech InfoTrellis offers managed Big Data Analytics Hub Solution Centered on Hadoop, which enables customers to consolidate multi-channel data of various formats into a single source. Big Data Analytics Hub enables self service analytics by different business functions.

Saturday, 13 May 2017

What are the characteristics of Big Data as a Service?

With rich experience in data management for more than a decade, InfoTrellis is pioneering big data management. Traditional data processing techniques are proving to be inadequate. We have the business acumen and technical expertise to provide the best-in-class solutions for handling big data.

Our Big Data Services Include:

Big Data Advisory


  • Leads you from Proof of Concept to Production implementation
  • Evaluates, models and incorporates the latest tools and technologies
  • Suggests a right fit of technologies based on requirements and budget


Architecture Consulting

  • The right architecture that suits your current needs and can be extended to fit your future needs
  • The right integration plan with your existing technology stack to minimize risk and align with cost and business strategy
  • Architecture consulting for your real-time data processing needs and batch processing

Friday, 20 January 2017

Top Reasons an MDM Implementation Fails

I often become involved in an organization’s MDM program when they’ve reached out to InfoTrellis for help with cleaning up after a failed project or initiating attempt number X at achieving what, to some, is a real struggle. There can be a lot of reasons for a Master Data Management implementation failing, and none of them are due to the litany of blame game reasons that can be used in these scenarios.  Most failures arise from common problems that people just were not prepared for.
Let’s examine some of the top reasons MDM implementations fail. In the end they probably won’t surprise you, but if you haven’t experienced it yet you will be better prepared to face them if they happen.

Underestimating the work

I am starting with this one because it leads to many of the others, and is a complex topic. It seems like a simple thing to estimate the work but there are a lot of aspects to an MDM project that aren’t obvious that can severely impact timelines and your success.

“It’s just a project like any other”

Let me start by saying MDM is not a project, it’s a journey, or at the very least a program.
Most organizations thinking about implementing MDM are large to global companies. Even medium sized companies that started small and experience growth over time have the same problems as their global sized piers.  While the size of the chaos in a global company may seem much larger, they also have far more resources to throw at the problem than their smaller brethren.
If we stick to the MDM party domain as a point of reference (most organizations start here with MDM), the number of sources or points of contact with party information can be staggering. You may have systems that:
  • Manage the selling of products or services to customers
  • Manage vendors you deal with or contract to
  • Extract data to data warehouse for customer analytics and vendor performance
  • HR systems to manage employees who may also be customers
  • Self-service customer portals
  • Marketing campaign management systems
  • Customer notification systems
  • Many others
A lot of large organizations will have all of these systems, each having multiple applications, and often multiple systems responsible for the same business function. So by now you are probably saying, yes I know this, and…?  Well your MDM “project” will need to sit in the middle of all of this, and in many cases since many of these systems will be legacy mainframe based systems, you will need to be transparent as these systems won’t be allowed to be changed.
MDM can be on the scale of many of the transformation programmes your organization may be undertaking to replace aging legacy systems and moving to modern distributed Service Oriented Architecture based solutions.

Big Bang Never Works

Now that we have seen the potential size of your MDM problem, let me just remind you that you can’t do it all at once. Sure you can plan your massive transformation programme and execute it – but if you have ever really done one of these, you know it’s a lot harder than it seems and that the outcome is usually not as satisfying as you expected it to be.  You end up cutting corners, blowing the budget, missing the timelines, and de-scoping the work just trying to deliver.
What is one of the typical reasons this happens on your MDM transformation project?



You Don’t Know What You Don’t Know

You have all these systems you are going to integrate with and in many cases you are going to need to be transparent in that those systems may not know they are going to be interacting with your new MDM solution. You are going to need to know things like:
  • What data do they use?
    • How often?
    • How much?
    • When?
  • Do they update the data?
    • How often?
    • How?
    • What?
  • Do they need to know about changes made by others?
    • How often is the change notice required?
    • Do they need to know it’s changed, or what the change was?
This type of information seems pretty straight forward. I haven’t told you anything you probably didn’t know, but, when you go to ask these questions, the answer you will mostly likely often get is:
“I don’t know.”
Ok, so the documentation isn’t quite up to date, (I am being kind), but you are just going to go out and find the answer. Which leads to the next problem.

Not Enough Resources

So this is an easy problem to solve. I’ll hire some more business analysts, get some more developers to look at the code, get some more project managers to keep them on track.  Seems like a plan, and on the surface it looks like the obvious answer, (ignoring how hard it is to locate available quality IT people these days), but these aren’t the resources that are the problem.Read More http://www.infotrellis.com/top-reasons-an-mdm-implementation-fails/

Thursday, 12 January 2017

Retailers’ Successes and Struggles with Big Data in 2014

Recent research by McKinsey and the Massachusetts Institute of Technology shows that companies that inject big data and analytics into their operations outperform their peers by 5% in productivity and 6% in profitability. Our experience suggests that for retail and CPG companies, the upside is at least as great, if not greater.”
Peter Breuer, director of McKinsey & Co.’s retail practice in Germany
With November half over and 2015 starting to peek at us over the horizon, we decided it was time to take a look at a few examples of what retailers have been using big data for in 2014. Here are three examples of use cases for Big Data in retail that have emerged in the last year, followed by a few InfoTrellis predictions about what will happen next in the new year when it comes to the evolution of how companies are implementing their Big Data strategies.

Macy’s

Personalized Marketing

The main goal for Macy’s CEO, Terry Lundgren, is to offer more localized, personalized and smarter retail customer experience across all channels. They use Big Data among others to create customer-centric assortments. They analyse a large amount of different data points, such as out-of-stock rates, price promotions, sell-through rates etc. and combine these with SKU data from a product at a certain location and time as well as customer data in order to optimize their local assortments to the individual customer segments in those locations.

 In addition to that, Macy’s gathers, and of course analyses, a vast amount of customer data ranging from visit frequencies and sales to style preferences and online & offline personal motivations. They use this data to create a personalized customer experience including customized incentives at checkouts. Even more, they are now capable of sending hyper-targeted direct mailings to their customers, including 500,000 unique versions of a single mailing. The results are compelling; Macy’s e-commerce division alone has witnessed a growth of over 10% and an overall annual revenue growth of 4% with the use of Big Data Analytics.
 (Macy’s Is Changing The Shopping Experience With Big Data Analytics)
 
Personalizing the user experience is a ubiquitous use case for big data, so it’s exciting to see a retailer actually implementing the technology to accomplish and prove out the value of this marketing strategy. Four percent growth is nothing to scoff at; this number represents millions of dollars on pure profit they didn’t have before. For companies that still believe they can accurately segment their hundreds of thousands of customers with fewer than a hundred profile archetypes, this is an undeniable piece of proof that they may need to consider getting on the bandwagon if they don’t want those millions of dollars to be coming out of their share of the customer’s spending habits.

What’s more, this is a front-and-center application of big data that is highly visible to the shopper. Whether or not they can articulate the difference in quality of experience they get from a retailer that uses it and a retailer that doesn’t, it’s a difference they can intuitively feel and will definitely react to by rewarding one store with loyalty over the others.

Once companies start pulling social data and combining it with internal customer data, their targeting and micro-segmentation capabilities will enable even more uniquely tailored marketing and customer experiences. So long as companies remember that the purpose of this data-collection is to minimize friction and irrelevant messaging for their customers and never to manipulate them or milk them for money like a mindless herd, the consumer stands only to benefit from the evolution of this practice.
For this reason, my prediction is that this will be a big differentiator in the coming years as the companies that experiment with it first (i.e. the early adopters) get better and better, making the gap increasingly noticeable to the end consumer. There will be a scramble by the companies that lagged behind to try to catch up, and this will represent a big shift for the retail industry’s established best practices in much the same way the idea of the loyalty program and the digital storefront did.

Read More http://www.infotrellis.com/retailers-successes-and-struggles-with-big-data-in-2014/

Thursday, 5 January 2017

Top Reasons an MDM Implementation Fails

I often become involved in an organization’s MDM program when they’ve reached out to InfoTrellis for help with cleaning up after a failed project or initiating attempt number X at achieving what, to some, is a real struggle. There can be a lot of reasons for a Master Data Management implementation failing, and none of them are due to the litany of blame game reasons that can be used in these scenarios.  Most failures arise from common problems that people just were not prepared for.
Let’s examine some of the top reasons MDM implementations fail. In the end they probably won’t surprise you, but if you haven’t experienced it yet you will be better prepared to face them if they happen.

Underestimating the work

I am starting with this one because it leads to many of the others, and is a complex topic. It seems like a simple thing to estimate the work but there are a lot of aspects to an MDM project that aren’t obvious that can severely impact timelines and your success.

“It’s just a project like any other”

Let me start by saying MDM is not a project, it’s a journey, or at the very least a program.
Most organizations thinking about implementing MDM are large to global companies. Even medium sized companies that started small and experience growth over time have the same problems as their global sized piers.  While the size of the chaos in a global company may seem much larger, they also have far more resources to throw at the problem than their smaller brethren.
If we stick to the MDM party domain as a point of reference (most organizations start here with MDM), the number of sources or points of contact with party information can be staggering. You may have systems that:
  • Manage the selling of products or services to customers
  • Manage vendors you deal with or contract to
  • Extract data to data warehouse for customer analytics and vendor performance
  • HR systems to manage employees who may also be customers
  • Self-service customer portals
  • Marketing campaign management systems
  • Customer notification systems
  • Many others
A lot of large organizations will have all of these systems, each having multiple applications, and often multiple systems responsible for the same business function. So by now you are probably saying, yes I know this, and…?  Well your MDM “project” will need to sit in the middle of all of this, and in many cases since many of these systems will be legacy mainframe based systems, you will need to be transparent as these systems won’t be allowed to be changed.
MDM can be on the scale of many of the transformation programmes your organization may be undertaking to replace aging legacy systems and moving to modern distributed Service Oriented Architecture based solutions.

Big Bang Never Works

Now that we have seen the potential size of your MDM problem, let me just remind you that you can’t do it all at once. Sure you can plan your massive transformation programme and execute it – but if you have ever really done one of these, you know it’s a lot harder than it seems and that the outcome is usually not as satisfying as you expected it to be.  You end up cutting corners, blowing the budget, missing the timelines, and de-scoping the work just trying to deliver.
What is one of the typical reasons this happens on your MDM transformation project?

You Don’t Know What You Don’t Know

You have all these systems you are going to integrate with and in many cases you are going to need to be transparent in that those systems may not know they are going to be interacting with your new MDM solution. You are going to need to know things like:
  • What data do they use?
    • How often?
    • How much?
    • When?
  • Do they update the data?
    • How often?
    • How?
    • What?
  • Do they need to know about changes made by others?
    • How often is the change notice required?
    • Do they need to know it’s changed, or what the change was?
This type of information seems pretty straight forward. I haven’t told you anything you probably didn’t know, but, when you go to ask these questions, the answer you will mostly likely often get is:
“I don’t know.”
Ok, so the documentation isn’t quite up to date, (I am being kind), but you are just going to go out and find the answer. Which leads to the next problem.

Not Enough Resources

So this is an easy problem to solve. I’ll hire some more business analysts, get some more developers to look at the code, get some more project managers to keep them on track.  Seems like a plan, and on the surface it looks like the obvious answer, (ignoring how hard it is to locate available quality IT people these days), but these aren’t the resources that are the problem.

You don’t have enough SMEs.

The BA’s, developers and others are all going to need time from your subject matter experts.  The subject matter experts are already busy because they are subject matter experts.  There typically aren’t enough of them to go around, and if you have a lot of systems to deal with, you are facing a lot of IT and business SME’s.
What your SMEs bring to the table is intellectual property. Intellectual property is critical to the success of your implementation.  You will need the knowledge your SMEs bring on your various systems, but there is another kind of intellectual property that you are going to need and can be tied to a very lengthy process.

Read More http://www.infotrellis.com/top-reasons-an-mdm-implementation-fails/

Wednesday, 23 November 2016

Virtual and Physical MDM in the same box, best of both worlds!

With the introduction of IBM Master Data Management v11, IBM has created a new implementation style combining the strengths of both MDM Physical and Virtual editions. While MDM Physical is more suited to the “centralized” MDM style (system of record), and MDM Virtual is aligned with the “registry” MDM style (system of reference), MDM Hybrid uses a “coexistence” style to provide a mixed system of reference & record. This article will give an overview of the MDM Hybrid implementation style and a couple of interesting lessons learned during a recent InfoTrellis engagement.
MDM Hybrid was first introduced in MDM v11.0 in June 2013 to leverage capabilities of both MDM Virtual and MDM Physical which themselves have grown considerably in capability in recent years. However, MDM Hybrid is still not yet mainstream due to a handful of reasons. One, it does represent a relative increase in complexity and requires practitioners competent in both MDM Virtual and MDM Physical. Two, it can be a difficult migration from an existing MDM Physical or MDM Virtual implementation (although the transition from virtual to hybrid is the easier of the two). Hopefully this article can help alleviate some of those concerns! We at InfoTrellis believe that MDM Hybrid is a strong offering that gives us the capability to have both Virtual MDM and Physical MDM in the same box – the best of both worlds. Additionally, MDM Hybrid is excellent for new MDM implementations, and can be implemented relatively quickly in a basic manner. IBM has also provided a detailed implementation path in its Knowledge Center (see link below).
When describing MDM Hybrid to clients, I have been couching it in terms of a “Virtual Side” and a “Physical Side”, as the product is still mostly segregated.   Between the two “sides” is a fence traversed by a physical MDM service. This MDM service, persistEntity, is one of the workhorses of any MDM Virtual implementation and will be the focus of much of the customization.

Member records (source data) are contained in the MDM Virtual side, processed through the powerful probabilistic matching process that MDM Virtual provides, and assembled into a “golden record” composite view that is then mapped into the MDM Physical schema and “thrown over the fence” to the MDM Physical side using the persistEntity service. The “golden record” is persisted on the physical side. Physical MDM services such as addParty and updateParty are disabled, and modifications to attributes mastered by the MDM Virtual side are not permitted. Other attributes, however, can be modified. For example, name types not in the golden record, privacy preferences, and product or contract data can be modified using standard Physical MDM services.
Special care needs to be taken when implementing the other MDM domains such as contract or product. The persistEntity service could initiate a call to deleteParty if the golden record no longer exists in the system – this could cause issues if there are Contract Roles or Party Product Roles. And how would one establish these in the first place? InfoTrellis recently implemented MDM hybrid with both the party and contract domains at a client, and we came away with some interesting lessons in how to accomplish this.
At our client, a large insurance corporation, we were charged with implementing MDM Hybrid using version 11.3 and using the Contract domain as well as the Party domain with both Persons and Orgs. While we implemented many pieces of the contract domain, this discussion will be simplified to contain the entities and attributes below.
In order to maintain contract role data, we had to create a “backpack” (and I’m sorry for the number of metaphors here – it helped us to explain this process to the client and has stuck in my mind as a method of explanation). This backpack would contain all the data needed to establish a contract role in Physical MDM and would accompany a party as it was processed by Virtual MDM and then get picked up by the persistEntity call on the round trip back into Physical MDM. On the virtual side, this data would not be used for searching or matching. On the Physical side, we had to create a transient data object (TDO) that would be mapped using the graphical data mapper (GDM) included in the workbench. This TDO is the backpack in the metaphor. Also, it needed to be added as an extension object under the TCRMOrganizationBObj & TCRMPersonBObj.
I hope this overview of the MDM Hybrid system has been informative. Unfortunately, as I wrote it, I noticed a number of components that I left out in the interest of giving a (hopefully) better overview of the case study without droning on for 20 pages. These include – handling role locations, customizing deleteParty, modifying the Virtual algorithm, constructing the composite view, and the framework we constructed to interface between Physical and Virtual MDM. We can dive deeper into those topics in a future article.
MDM Hybrid provides a number of exciting new functionalities, and with the flexibility inherent in the IBM MDM product, there remain many unexplored avenues and even ways of doing the same thing. Between MDM Virtual, MDM Physical, and now MDM Hybrid there’s no excuse to avoid creating a Master Data Management solution in your organization. If you’re considering an MDM Hybrid implementation (Or any other IBM MDM solution), give us a call! Contact More

Monday, 21 November 2016

Initiate your Data Governance

Data Governance is an important and imperative area for Enterprises that want to realize full value from the data available with them.  InfoTrellis’ Data Governance Methodology follows a multi-phased iterative approach with 4 stages – Initiate, Define, Deploy and Optimize. This article lists the important considerations that are part of the Initiate stage of our Data Governance Methodology.
The Debate– Small or Big? The very first step of Data Governance is also the most ambiguous for most enterprises. The most common debate is whether to start an independent Data Governance program across enterprise or to start with specific problem at hand and then scale big. Most enterprises that are successful with Data Governance start small with a specific domain or business area to solve a data issue and then expand. The few enterprises that aim for enterprise wide Data Governance, break their program in small iterative steps to achieve success. So whatever the approach, – small or big – having small iterative steps is the key. It is critical to resolve this debate and finalize on the strategy before embarking on further activities.
Maturity Assessment – Assessing the current state of information management is essential to understand why things went wrong and how they can be fixed. Clients can adopt any of the leading Maturity Standards for their Data Governance Program including the one from InfoTrellis. These standards are referenced to mark the current maturity level of a particular business area. It is a normal scenario to have different maturity levels for different business areas of an enterprise. We suggest that specific prescriptive roadmap be defined considering the individual maturity level of each area. The maturity assessment needs review after each iterative deployment of Data Governance policies.
Data Governance Roadmap– The roadmap defines the steps to be taken to reach the desired state of Data Governance. This can be specific to a business area at the start and can be refined based on each of the incremental Data Governance deployments.
Secure Sponsorship – A compelling business case highlighting the business problem, its impact on revenue and cost and how it can be resolved by Data Governance, is important for getting the attention of executives and the subsequent sponsorship. Many Data Governance programs lose steam mid-way due to inadequate sponsorship. Executives have to continuously send messages to the team, educating and reinforcing the importance of achieving data governance goals.
Assign an effective Program Manager – Data Governance programs are complex programs requiring top notch process and people skills and needs continuity. Hence identifying the right program manager with clearly defined roles and responsibilities is very important for a successful program. We have seen many programs suffer due to ambiguous or frequently changing Program Managers.
In conclusion, each enterprise begins its data governance program differently. But addressing each of the above considerations and activities proactively helps setup a path to success.
Check out the Part 2 of this 4 part series on Data Governance from InfoTrellis – Define your Data Governance
Please send us a note with your queries and feedback. Contact more.

Saturday, 10 September 2016

Big Data Management Services by InfoTrellis

With rich experience in data management for more than a decade, InfoTrellis is pioneering big data management. Traditional data processing techniques are proving to be inadequate. We have the business acumen and technical expertise to provide the best-in-class solutions for handling big data.

Our Big Data Services Include:

Big Data Advisory

  •     Leads you from Proof of Concept to Production implementation
  •     Evaluates, models and incorporates the latest tools and technologies
  •     Suggests a right fit of technologies based on requirements and budget

Architecture Consulting

  • The right architecture that suits your current needs and can be extended to fit your future needs
  • The right integration plan with your existing technology stack to minimize risk and align with cost and business strategy
  • Architecture consulting for your real-time data processing needs and batch processing

Visit us at http://www.infotrellis.com/big-data/