Analytics Articles

  • high-level-diagram-of-user-migration-and-dataset-deprecation-tool

    Co-authors: Steven Chuang, Qinyu Yue, Aravind Rao, and Srihari Duddukuru Introduction Having recently transitioned LinkedIn’s analytics stack (including 1400+ datasets, 900+ data flows, and 2100+ users) to one based on open source big data technologies, we wanted to give an overview of the journey in a blog post. This move freed us from the limits imposed by...

  • a-graph-showing-keyword-search-query-p95-latency-with-increasing-qps-for-different-workloads

    Text analytics on LinkedIn Talent Insights using Apache Pinot

    June 16, 2021

    Co-authors: Siddharth Teotia and Tim Santos Introduction LinkedIn Talent Insights (LTI) is a platform that helps organizations understand the external labor market and their internal workforce, and enables the long term success of their employees. Users of LTI have the flexibility to construct searches using the various facets of the LinkedIn Economic Graph...

  • privacypreserving1

    Privacy-preserving analytics and reporting at LinkedIn

    April 10, 2019

    Co-authors: Krishnaram Kenthapadi, Thanh Tran, Mark Dietz, and Ian Koeppe Preserving privacy of users is a key requirement of web-scale data mining applications and systems such as web search, recommender systems, crowdsourced platforms, and analytics applications. With the growing appreciation of the impact of data breaches and comprehensive data regulations,...

  • behind-big-data-and-ai-1

    Behind "Big Data" and "AI": Elements of Modern Data Science

    April 5, 2018

    I’m sure everyone who has been following tech industry news knows about “big data” and “AI.” Although there is no industry-consistent...

  • qingbo1

    Getting to Know Qingbo Hu

    June 23, 2017

    Qingbo Hu is a Senior Business Analytics Associate in LinkedIn’s Analytics Data Mining team. His team provides end-to-end data mining...

  • explodingdata1

    Managing "Exploding" Big Data

    June 15, 2017

    What is the shape of your big data? While we do love to talk about the size of our big data—terabytes, petabytes, and beyond—perhaps...