SparkSQL SQL Parser

The built-in SparkSQL 3 SQL engine in General SQL Parser provides in-depth analysis of an organization's SparkSQL SQL script at a detailed level that would not be possible without a complete, 100% compatible query parser.

Parsing SQL is a notoriously difficult task because the syntax of SparkSQL SQL is very ambiguous in many places. Many people have attempted to write a complete SQL grammar with parser generate tool and failed.

Now you can fully incorporate this SparkSQL SQL parser into your products, instantly adding a powerful SQL processing capability to your program. With the proper library, you can get your job done quickly by saving hundreds of hours, if not more, on developing time.

Column-level data lineage discovery

One of the fantastic features provided by this SparkSQL parser is discovering the lineage from the complex SparkSQL queries.

Take this query for example:

INSERT OVERWRITE DIRECTORY 's3:///bucket/path/to/report'
USING parquet
OPTIONS (col1 1, col2 'sum')
SELECT bar.my_flag,sum(foo.amount) as amount_sum 
FROM mydb.foo foo 
left join mydb.bar bar
on foo.bar_fk = bar.pk
group by bar.my_flag;

Click here to try your SparkSQL queries

Clean up messy SQL codes

Easily integrate SQL formatter into your application for a color coded layout that is easy to navigate, giving your product a professional feeling.

Detect SQL syntax errors

Your application will be able to validate SQL syntax before a database executes the query. This is very useful especially if your SQL was dynamically built based on user input.

Rid SQL injections

Avoid being vulnerable to SQL injection in your ASP.NET or Java application, by automatically detecting malicious SQL segment with our ready-to-use library.

Retrieve/Refactor table & column name

Precisely determining and renaming every table and column in stored SQL statements is very complex with a lot of nesting and sub-queries. With us, however, that tedious procedure can become hassle-free one for you.

Find affected SQL objects

Parse out the affect SQL objects in a SQL file that can have many different types of SQL (select, insert, create, drop, etc), and helping to determine what is being affected, including but not limited to schema, table, column.

Discover the relationship in DDL

Quickly locate the primary key and/or foreign key in DDL scripts to figure out the complex relationship among the various tables. Extracted table, attribute names, data types can be used to generate the CRUD-Statements.

Query parse tree in XML

Parsing SQL is a notoriously difficult task, but we are here to help. You will be provided with a SQL query parse tree in XML output that will allow you to further process SQL scripts.

Rewrite and convert SQL

Modify SQL expression/condition in where clause to reconstruct a new filter. Rewrite Oracle proprietary joins to ANSI SQL compliant joins. Translate SQL between different databases.

CRUD Reportor

Read complex and large SQL scripts to find out tables have Create, Read, Update, Delete and Insert operations against them immediately, it's almost impossible to do that without help with a tool.

SQL Parser can even do more

We are dedicated to constantly improving our product so it will be easier to use with more flexibility, making it a valuable asset to your software product. Here, we have provided you with additional demos that may be helpful to you.

Supported SQL

Level 1: SQL parser recognizes that this is a valid SQL statement, but can't validate the syntax of this specific SQL statement. This demo shows how General SQL Parser can handle this kind of SQL statements.

Level 2: SQL Parser fully parses this kind of SQL statements with detailed query parse tree node elements and provides everything you need to analyze and manipulate this kind of SQL statements.

Level 1 statements: 47, Level 2 statements: 37, generated by General SQL Parser Java Version 2.3.0.7,2021/06/02

SQL statements	Level 1	Level 2
add file	Y	Y
add jar	Y	Y
alter database	Y	Y
alter table	Y	Y
alter view	Y	Y
analyze table	Y	Y
cache table	Y	Y
clear table	Y	Y
create external table	Y	Y
create database	Y	Y
create function	Y	Y
create view	Y	Y
Describe	Y	Y
Describe database	Y
Describe function	Y
Describe query	Y
drop schema	Y	Y
drop function	Y	Y
drop table	Y	Y
drop view	Y	Y
explain	Y	Y
insert	Y	Y
list file	Y	Y
list jar	Y	Y
load data	Y	Y
msck repair table	Y
refresh	Y	Y
refresh function	Y	Y
refresh table	Y	Y
reset	Y	Y
select	Y	Y
set	Y	Y
set time zone	Y	Y
show columns	Y	Y
show create table	Y	Y
show databases	Y	Y
show functions	Y	Y
show partitions	Y	Y
show table extended	Y	Y
show tables	Y	Y
show tblproperties	Y	Y
show user	Y	Y
show views	Y	Y
truncate table	Y	Y
repair table	Y
uncache table	Y
use	Y	Y

Questions?

If you have any questions about General SQL Parser, You can always send us an email and we'll get back to you within 24 hours.

Any other benefits can I get by using this SQL Parser?

Yes, of course. We collect all kinds of examples in this page to illustrate how and why you want to use general sql parser, hope it can help you to make better use of this library.