For more detailed usage, please refer to the PowerPoint file under the docs
directory
DBCLI is a portable database command line utility, for DBA or application support to easily manage and run their common used scripts, similar to database built-in CLI tools but is more flexible.
It is mainly developed by Lua language, and bridges to JDBC to access database, many of the files are SQL scripts that easy to maintain.
It is designed to support multiple databases, and includes 2 types of modules, one is the public module whose functions are visible across all database platforms,
and another one is the platform-specific module.
It is not intended to support all features of the existing CLI utilities that embedded by the specific database(Oracle SQL*Plus
, DB2 CLP
, etc), but to provide the features other than those tools:
alias
command to reduce the frequent inputssnap
and ora
commands as the replacement of the standard CLI scripts, so that DBA is able to quickly define and execute the SQL templates with the smallest inputDBCLI does not require compile or installation, but depends on JRE 1.8+. Click Download ZIP
,extract and use. Or you can also download from the published releases
Branch With-JRE
contains the shrinked JRE bundle, if you don't have JRE installed,
you may switch to that branch to download. Due to the region and charset differences, this JRE bundle is not guaranteed to work well.
For Windows OS, to avoid the word wrap in the terminal window which affects the print layout, following settings are recommended in Windows command window:
Layout
tab, set buffer width and buffer height as 500+
Font
tab, change the font size as smaller value.Linux must be the 64-bit
version, and make sure glibc >= v2.4
(use ldd --version
to verify) are installed. You can use command <command> | more
to vertically/horizontally scroll the command output, or more last
or scroll the last command output.
Only tested on OSX 10.12, lower version should be fine. Java 1.8+ is required. It's recommended to add entry <hostname>.local
into /etc/hosts
to speed up the JVM performance.
For Example:
127.0.0.1 localhost mac-pc.local
::1 localhost mac-pc.local
And sometimes you may run into below exception when try to execute dbcli.sh
:
"luajit" cannot be opened because the developer cannot be verified
The solution is to disable the restriction: sudo spctl --master-disable
Before running dbcli, make sure that you have installed JRE 1.8+ in your local PC. If you are using the version of "With-JRE" branch, this step can be skipped.
Create file init.cfg
(or init.conf
for non-Windows) under the "data" directory with following content(for non-Windows OS use export
instead):
SET JRE_HOME=<JRE HOME>
SET TNS_ADM=<location of tnsnames.ora>
Of which TNS_ADM
is optional unless you need to connect Oracle via tnsnames.ora, or may also refer to init_sample.cfg
for more settings. An example is:
SET JRE_HOME=d:\soft\java
SET TNS_ADM=d:\Soft\InstanceClient\network\admin
The default charset is UTF-8
, to use another charset, just change the DBCLI_ENCODING
environment variable globally or in the mentioned config file. For example:
SET DBCLI_ENCODING=GBK
(for Windows)DBCLI_ENCODING=GBK ./dbcli.sh
After the above configurations, you are able to start DBCLI by executing dbcli.bat
or bin\ConsoleZ\Console.exe
.
dbcli.bat
also supports arguments in "<command>=<args>"
format, all available commands can be found by typing help
or help -a
.
For example: dbcli.bat "connect=tiger/scott@orcl"
DBCLI supports multiple database platforms(oracle,mysql,db2,etc), default is Oracle
.
To permanently change the preferred platform other than Oracle
, run set -p platform <platform>
after launching the console.
For example, set -p platform db2
Without the -p
option, the change only takes affect on current console window.
Type set platform
to see all available options.
Public Commands: visible in all database platforms
help
: Show help information,Use "help <command>"
to show the detail information of other commands, or "help help"
to see more usage of the help
command. Oracle
, to switch to other platform, use the "set [-p] platform"
commandansi
:Show the usage of console color solutionhotkeys
:Show the available hotkeys in console|set
:A command set, show or change all kinds of preferences of console environment or other commands. The changed settings can be either permanent or temporary.alias
:A command set, similar to the Unix alias
command, mainly used to define the shortcut of other command line, the definition is automatially stored in folder aliases
for permanent reused|history/his
:Check or run historical commands, and the historial commands are only kept in memory and available within the current windowr
or /
:Rerun previous commandsleep
:Sleep for specific seconds, mainly used in script filerepeat/itv
:Periodically run other commandshost
or !
:Run OS commandreload
:Close all connections and reload the console environment, everything will be reset.exit
:Close all connections and close the consoleclear/cls
:Clear screenspool/spo
:Sync screen output to file, the command name can be different regarding to different db platformscolumn/col
:Control the layout format of grid(i.e. query) fieldgrep
:Similar to the Unix grep
command but only supports piping from other commandmore
:Similar to the Unix more
command but only supports piping from other commandtee
:Similar to the Unix tee
command but only supports piping from other command, also can export the screen output into csv
or html
format regarding to the file extension, the command name can be different regarding to different db platformsprompt/pro/echo
:Print text, if the text contains variables, then also convert as the the vairable values, the command name can be different regarding to different db platformsconnect/conn
:Connect to database, Usage: "conn user/password@connection-string"
data\jdbc_url.cfg
, or follow the JDBC thin URL format, and for different database platform, the URL format can be different, normally in host:port/database-or-else
format. But for Oracle
database, it also supports TNS-NAME
and EZConnect
. Type help connect
for more informationlogin/logon
:A command set, view or logon to a connection history, when a connection is successfully established, the logon info would be automatially stored in data\password.dat
, so that user doesn't have to manually input the a/c for each timedisconnect/disc
:Disconnect the current connection|Commit
: Commit DML changes, only available when autocommit mode is on
Rollback
: Rollback DML changes, only available when autocommit mode is on
*
:A command set, run customized script file which includes a batch of commands that supported in DBCLI, supports the features of variables, options and pre-compiled conditions. The engine maps the input parameters as V1 - V20
variables except the parameter in -<option>
format. This is the interface for some other commands to implement or extend, such as snap
/shell
/ora
/sys
/chart
/sql
/etc, different command owns different folder to store the script files, and those file names are regconized as the sub-command names.snap
:A command set,used in following scenario: [capture db pre-stats] => [run other commands / sleep for seconds] => [capture db post-stats] => [generate db delta-stats]
chart/ch
:A command set, run customized script to generate graph chart from SQL statementgraph/gr
:Generate graph chart from input parameter which is a SQL text or a CSV filedefine/def
:Define variable with initial value, can be used in either SQL bindings or text substitution in command or script filevariable/var
:Define variable and its data type without value assignment, can be used as the output binding parameter of the SQL statement, mainly used in customized script fileaccept/acc
:Assign user-input or file to a new variablesave
:Save a specific variable value into target fileprint/pri
:Print target variable sql2file
:Generate the result of a query or cursor into SQL file, supports auto-compression regarding to the target file extensionsql2csv
:Generate the result of a query or cursor into CSV file and sqlldr
control file, supports auto-compression regarding to the target file extensioncsv2sql
:Convert CSV file into SQL file and sqlldr
control file, supports auto-compression regarding to the target file extensionssh
:A command set to communicate between client and SSH servershell
:A command set, run in remote SSH sever with local shell/python/perl script(to be enhanced), this command is inherited from the scripting modulesevent
:Show event bindings of the console codeluajit
:Switch into thea LuaJIT
consoleilua
:Enter into Lua console, can access environment objectssearch
:Search the source code-p
:Test a command and verify its input parametershelp -a
or set -a
: see where the commands/settings are definedOracle Database
*
:Supports almost all Oracle database SQL statementsawrdump
:Generate AWR report regarding to the input time range or snap_idawrdiff
:Generate AWR diff report regarding to the input time range or snap_idaddmdump
:Generate ADDM report regarding to the input time range or snap_idaddmdiff
:Generate ADDM diff report regarding to the input time range or snap_idashdump
:Generate ASH report regarding to the input time range or snap_idloadtrace/dumptrace
:Download the self/alert/other trace file from db server,requires the create/drop any directory
access rights if unable to access the target OS path with existing Oracle directoriessqlprof
:Generate SQL profile script from sqlarea/awr/spm/profile/plan_table/etcunwrap
:Extract PL/SQL code or view from database into local file, if the code is encrypted, then auto-decrypt it ora
:A command set that implement the scripting engine, to run predefined or customized script that used for DBA or db developer, this command has pre-defined many useful scriptssys
:A command set that inherited from ora
and similar to ora
, except can only used by SYSDBAshow
:A command set that inherited from ora
and similar to ora
, except that it doesn't accept input parametersexa
: A command set that inherited from ora
, used to query Exadata
cell configurations and statisticsessqlplus
:Launch sqlplus
console with the same login in native mode or embbed mode, plus other input parameters@
or sp
:Run sqlplus script in embbed mode with the same loginset instance
:Auto-limit the instance regarding to any SQL that references the gv$/x$/dba_hist
viewsset container
:Auto-limit the container ID regarding to any SQL that references the views that have the con_id
fieldset starttime
:Auto-limit the default begin time of the predefined SQLs that specify the time range predicateset endtime
:Auto-limit the default end time of the predefined SQLs that specify the time range predicatedescribe/desc
:Describe Oracle object, provides more features than that of sqlplus
xplan
:Show execution plan for input SQL text/ID
, as well as downloading the 10053 trace file if specify the -10053
optionMySQL Database(to be enhanced)
*
:Supports almost all MySQL database SQL statementsmysql
:Switch to mysql.exe
with same login plus other input parametersmysqluc
:Switch to mysqluc.exe
with same login plus other input parameterssource
or \.
or ms
:Switch to mysql.exe
with same login to execute the target scriptsql
:Inherited from the scripting engine, to run the script which contains a batches of all available commandsps
:Similar to sql
except that it's based on performance_schema
ti
:Similar to sql
except that it's for TiDB
onlylist
:Similar to sql
except that it accepts no parameters?
or \?
: A bit different from the native \?
, provides more featuresN/A
: Some commands are similar to the native mysql
consoleinfo
: Describes object more detailPostgreSQL Database(to be enhanced)
*
:Supports almost all PostgreSQL database SQL statementspsql
:Switch to psql.exe
with same login plus other input parametersfile
or -f
:Switch to psql.exe
with same login and execute the target scriptsql
:Inherited from the scripting engine, to run scripts which contains a batches of all available commandN/A
: Some commands are similar to the native psql
consoleThe command rules are similar to SQL*Plus:
create trigger/package/function/procedure/type
) are cross-lines commands and should be end with /
in a stand-alone line. create table/index/etc
are not of this kind because they are related to structures.;
, or /
in a new line.SET COMMAND_ENDMARKS
is used to customize those 2 symbols.Enter
key is pressed.
Type help -a
and refer to the Cross-lines
field for the type of each command. For the output lines that wider than the buffer width(in Posix System it's the screen width), the overflow part will be trimmed. To view the complete information:
<command> | less
to enter Linux-style less
mode, and press arrow
keys to scroll the screenless last
to view the last output in less
modeout
to launch the default editor to see the historical output. If the default editor is vi
, execute :set nowrap
and use hotkey e/b/zL/zH
to horizontally scroll the screen.
To change the default editor, use set [-p] editor <executable name>
. For example, set editor code
dbcli
has defined some colors that used in different scenario, those colors can be found by set color
.
You are able to change the colors by executing set [-p] <color name> <new code>
, of which the code can be referenced by command ansi
, and -p
means permanently.
For example, set promptcolor BLU;BWHT;UDL
is to change the prompt color as Blue Foreground + White Background + Underlined
, and set promptcolor default
to change as default.
It's possible to turn of using colors, which is done by executing set ansicolor off
There are 5 zip files in the releases
page that used in different scenario, all those releases don't include the src
directory:
dbcli_all.zip
: includes everythingdbcli_win.zip
: excludes the jre_linux
directory and include JRE 1.8
for Windows
dbcli_linux.zip
: excludes the jre
directory and include JRE 1.8
for Linux
dbcli_nojre.zip
: excludes the jre/jre_linux
directoriesdbcli_oracle_lite.zip
: excludes the jre/jre_linux/bin/docs
directories, you can remove more sub-directories under lib
depending on your OS. The utility depends on some binary files of open-source projects, the authors own the rights. The binaries have been included into this project. Below is the list:
JLine3 : (BSD) https://github.com/jline/jline3
JSch : (BSD) http://www.jcraft.com/jsch/
ConsoleZ : (GNU) https://github.com/cbucher/console
luajit v2.1 : (MIT) https://github.com/LuaJIT/LuaJIT
jnlua : (MIT) https://github.com/hyee/JNLuaJIT(revised from jnlua.googlecode.com)
OpenCSV : (MIT) https://github.com/hyee/OpenCSV(revised from opencsv.sourceforge.net)
MessagePack : (MIT) https://github.com/fperrad/lua-MessagePack (pure lua)
dygraphs : (MIT) https://github.com/danvk/dygraphs
JsonForLua : (MIT) https://github.com/craigmj/json4lua
PSCP : (MIT) http://www.putty.org/
LPeg : (MIT) http://www.inf.puc-rio.br/~roberto/lpeg
xml2lua : (MIT) https://github.com/manoelcampos/xml2lua
JNA : (LGPL) https://github.com/java-native-access/jna
NuProcess : (Apache) https://github.com/brettwooldridge/NuProcess
Luv(libuv) : (Apache) https://github.com/luvit/luv
ConEmu : (BSD) https://github.com/Maximus5/ConEmu
juniversalchardet : https://github.com/albfernandez/juniversalchardet
Besides, some SQL scripts come from internet.
You are able to use command alias
to define the shortcut of the simple command, for instance:
alias sf select * from (select * from $*) where rownum<=50;
In this case, you can execute sf dba_objects where object_id<1000
to simplify the input.
The alias
command supports the $1-$9
and $*
wildcard characters, of which $n
corresponds to the n
th parameter, and $*
means the concatenation of $n+1
-$9
via space.
Type alias
to see more usage.
Similar to SQLPlus script, a sub-command script is the combination of one or more existing commands that supports user-input parameters.
Take command ora
for example, to define a sub-command xxx
, create file oracle\ora\xxx.sql
and fill with following content:
`select from (select * from &V1) where rownum<=50;`
After that, run ora -r
to take effect, then you can run ora xxx dba_objects
to query the view.
The utility has created some pre-defined commands, if you want to modify the those commands without concerning of overriding back by the new version, just create a sub-folder under the ora
directory, and put the updated file into it, because for the scripts with same name, the one in the sub directory will be treated as higher priority. Or you may also use ora -l <path>
to link to another work dir.
Commands ora/show/sys/snap/chart/sql/shell/etc
follow the similar rules:
:V1-:V20
or &V1-&V20
as the input parameters, of which :Vn
means binding parameters, and &Vn
means variable substitution./*[[...]]*/
is optional, as the help or usage information--[[...]]--
inside the help comment is also optional, normally used to specify the command options(i.e., ora actives -m
) and access validation, refer to other sub-commands for more examples.Different from sub-commands, the root command must be a lua script. To plug a user-define lua script into the utility, just add its path in data\plugin.cfg
, you may refer to data\plugin_sample.cfg
for the example.
Below are the common interfaces that can be used in the script:
env.set_command(...)
env.set.init_cfg(...)
env.snoop('<event_name>', <parameters>)
env.getdb()
You may also:
help -a
or set -a
or event
to see how those interfaces are used in other scriptshelp -e env[.module] 2
to see the available interfaces, i.e.: help -e env.oracle 2