• Evolving the LinkedIn Business Platform

    March 27, 2023

    At LinkedIn, one of our most important goals is to offer a top-notch experience for all of our customers. Purchasing is a big part of that customer experience, and it is not as straightforward as many people would think. It can be complex and difficult to navigate, which makes the LinkedIn Business Platform such an important tool for delivering high-quality...

  • Unified Streaming And Batch Pipelines At LinkedIn: Reducing Processing time by 94% with Apache Beam

    March 23, 2023

    Co-Authors: Yuhong Cheng, Shangjin Zhang, Xinyu Liu, and Yi Pan Efficient data processing is crucial in reducing learning curves, simplifying maintenance efforts, and decreasing operational complexity. This, in turn, helps engineers to develop and deploy data processing applications quickly and easily, powering various business requirements, and enhancing member...

  • Building and maintaining the skills taxonomy that powers LinkedIn's Skills Graph

    March 21, 2023

    Co-authors: Sofus Macskássy, Carol Jin, Shiyong Lin, Xiaomin Wei, and Michael O’Neill When we think of skills, we think of the unique knowledge, expertise, and abilities that each of us has. At LinkedIn, we see skills as more – we see them as a way to level the playing field in the labor market because they represent what a member is capable of – not where they...

  • Scaling AutoBuild: Our Journey Towards Delivering An...

    March 14, 2023

    Ensuring operating system upgrades are done quickly and efficiently is just one way we ensure that the underlying applications and our...

  • Reducing Apache Spark Application Dependencies Upload by 99%

    March 9, 2023

    Co-authors: Shu Wang, Biao He, and Minchu Yang At LinkedIn, Apache Spark is our primary compute engine for offline data analytics such...

  • AI @ LinkedIn - It’s All About Foundations

    March 8, 2023

    For our engineering teams, artificial intelligence (AI) is like oxygen - it powers every product we build and every experience we...