On Tuesday, September 20th, 2022, TechPlay will host a recruiting event titled “Technologies Supporting PayPay’s Data Infrastructure – Challenges of the Data Management Department and DWH/BI tool technologies supporting a large-scale Product with 50 million users and over 3.6 billion number of payments – [PayPay Growth Tech vol.3”
PayPay, a “super app” that integrates not only mobile payment functions but also multifunctional services, has 50 million users, 3.66 million merchant(s) applications, and over 3.6 billion number of payments, and a large amount of data is accumulated daily.
Data utilization in such a huge data set can cause a variety of problems.
- Tables created by some users are used company-wide before you know it.
- Users on the business side do not know what they need and what kind of aggregation they are doing.
- Wasteful queries and zombie queries are costing too much.
- There is no place to inquire about Data Infrastructure among users or from users
etc…
We will discuss the path from where two volunteer employees were originally analyzing and managing company-wide data to the establishment of the Data Management Department, an organization dedicated to the development and management of the company-wide Data Infrastructure.
The presentation will then delve into how the DWH and BI tools, which are essential components of a data analysis infrastructure, are used to solve problems that arise on a day-to-day basis.
PayPay uses Google BigQuery for DWH and Looker for BI tools.
What is it like in actual operation? We will also share with you the real voice of the company.
Please feel free to join us.
【Event Information】
- 19:00〜19:05
Opening
- 19:05～19:20
Launching the PayPay Data Infrastructure team, the team’s role and operations
Takayuki Mieno
We will talk about how the team was set up, how the team is managed, and how the team’s roles are defined, communicated, and developed.
- 19:20〜19:35
The pipeline environment and company-wide common tables that support PayPay’s data utilization
Koshiba
I will talk about how we solved the technical debt around the data warehouse (pipeline environment and company-wide common tables), and how we are working to create a system that is easier to operate, such as dbt.
- 19:35～19:50
PayPay’s Looker launch, challenges and solutions for user deployment
Kil
I will talk about how we launched Looker, our BI Platform, the challenges I faced as an engineer leading the BI project, how we solved those challenges, and what we are doing to further improve the BI environment.
- 19:50～20:10
Ｑ&Ａ
- 20:10〜20:20
Closing
※Due to this position needs business level of Japanese, this event will be held in Japanese only. ※Anyone can join this Seminar from any location. ※you can join this event for free. ※You can leave during the Seminar. ※This Seminar is held in Japanese. ※Feel free to ask any question for speakers in chat during this seminar.
※Due to this position needs business level of Japanese, this event will be held in Japanese only. ※Anyone can join this Seminar from any location. ※you can join this event for free. ※You can leave during the Seminar. ※This Seminar is held in Japanese. ※Feel free to ask any question for speakers in chat during this seminar.
- Due to this position needs business level of Japanese, this event will be held in Japanese only.
- Anyone can join this Seminar from any location.
- you can join this event for free.
- You can leave during the Seminar.
- This Seminar is held in Japanese.
- Feel free to ask any question for speakers in chat during this seminar.
Please click here to apply for this event
