Skip to content

The ClickHouse Ingestion Tool is a full-stack application designed to facilitate bidirectional data ingestion between ClickHouse (a fast, columnar database) and flat files (such as CSV and TSV). This tool offers a simple and secure way for users to upload data from flat files into ClickHouse or export data from ClickHouse to flat files.

Notifications You must be signed in to change notification settings

Lishagoel/ClickHouseIngestion

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ClickHouse Ingestion Tool

Overview

The ClickHouse Ingestion Tool is a full-stack application designed to facilitate bidirectional data ingestion between ClickHouse and flat files (e.g., CSV, TSV) using a Spring Boot backend and a React frontend. It supports features such as schema discovery, column selection, JWT-based authentication, and data export.


Features

  • Bidirectional Data Ingestion: Ingest data from flat files into ClickHouse and vice versa.
  • Schema Discovery: Dynamically fetch and display the schema of ClickHouse tables.
  • Column Selection: Allow users to select specific columns for ingestion.
  • JWT Authentication: Secure the application with JWT tokens for authorization.
  • File Export: Export data from ClickHouse to flat files (CSV).

Tech Stack

  • Backend: Spring Boot (Java)
  • Frontend: React
  • Database: ClickHouse
  • Authentication: JWT (JSON Web Tokens)
  • UI Framework: Bootstrap/Material UI (choose whichever you use)
  • Build Tool: Maven

Screenshots

1. ClickHouse

click

2. mvn Success

mvn

3. Spring-Boot Init

spring

4. Spring-Boot Success

spring

About

The ClickHouse Ingestion Tool is a full-stack application designed to facilitate bidirectional data ingestion between ClickHouse (a fast, columnar database) and flat files (such as CSV and TSV). This tool offers a simple and secure way for users to upload data from flat files into ClickHouse or export data from ClickHouse to flat files.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages