Code Monkey home page Code Monkey logo

aliyun-odps-console's Introduction

README.md # ODPS Console

Build Status

Downloads

https://github.com/aliyun/aliyun-odps-console/releases/latest/download/odpscmd_public.zip

If the download link above doesn't work, please try the following link:

https://maxcompute-repo.oss-cn-hangzhou.aliyuncs.com/odpscmd/latest/odpscmd_public.zip

Requirements

  • Java 8+

Build

git clone ...
cd aliyun-odps-console
mvn clean package -DskipTests

Run Unittest

  • you will have to configure there odps_config.ini files in source tree:
odps-console-tunnel/src/test/resources/odps_config.ini
odps-console-dist-public/odps_config.ini
odps-console-public/src/test/resources/odps_config.ini
odps-console-mr/src/test/resources/odps_config.ini
odps-console-sql/src/test/resources/odps_config.ini
odps-console-xflow/src/test/resources/odps_config.ini
odps-console-auth/src/test/resources/odps_config.ini
odps-console-basic/src/test/resources/odps_config.ini
odps-console-dship/src/test/resources/odps_config.ini
odps-console-resource/src/test/resources/odps_config.ini
  • mvn clean test

Authors && Contributors

License

licensed under the Apache License 2.0

aliyun-odps-console's People

Contributors

cornmonster avatar guozhenhong avatar idleyui avatar lyman avatar supermichelle7 avatar zhangdingxin484 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

aliyun-odps-console's Issues

Log level of odpscmd

Could we set log level to odpscmd since there're too many INFO and i just want ERROR among them?

Add silent mode to odpscmd

Could we add silent mode to odpscmd as mysql and hive do?
i.e. Make the stdout output of odpscmd -e "sql" the pure query result without table pattern like:
(a weird newline here in stdout)
+----+
| |
+----+
This would really help if I want to save query result to local disk since odpscmd provides no query result -> local_disk command.

Package not found - kNotFound

FAILED: ODPS-0433221: Package not found - kNotFound:Get major version specified by project gray failed. kNotFound:SQL_RT_TASK package of version default not exist.

Strange ParseException: format error, DATETIME Unparseable date.

Hi there,
I can't load 20110328035927 value to either datetime or timestamp column. (with data format pattern: "yyyyMMddHHmmss").

both tried odps.sql.type.system.odps2=true and false.

Also when i change input value, insert succeeded but query result returns input date with plus 6hours.. 20110328000000 >>>> 2011-03-28 06:00:00

Reproduce steps:

openjdk version "1.8.0_201"
OpenJDK Runtime Environment (build 1.8.0_201-b09)
OpenJDK 64-Bit Server VM (build 25.201-b09, mixed mode)

Aliyun ODPS Command Line Tool Version 0.29.1

echo "20110328035927" > import.csv
odps@ **my_account**>set odps.sql.type.system.odps2=false;

OK
odps@ **my_account**>tunnel upload -dfp 'yyyyMMddHHmmss' ~/import.csv tbl_datetime;
Upload session: 201903142005421875c00b0242854d
Start upload:/home/username/import.csv
Using \n to split records
Upload in strict schema mode: true
Total bytes:15	 Split input to 1 blocks
2019-03-14 15:05:42	scan block: '1'
java.util.concurrent.ExecutionException: org.apache.commons.cli.ParseException: ERROR: format error - :1, DATETIME:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at com.aliyun.odps.ship.upload.DshipUpload.uploadBlock(DshipUpload.java:224)
	at com.aliyun.odps.ship.upload.DshipUpload.upload(DshipUpload.java:166)
	at com.aliyun.odps.ship.DShip.runSubCommand(DShip.java:71)
	at com.aliyun.odps.ship.DShipCommand.run(DShipCommand.java:99)
	at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:151)
	at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:50)
	at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)
Caused by: org.apache.commons.cli.ParseException: ERROR: format error - :1, DATETIME:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at com.aliyun.odps.ship.upload.BlockUploader.doUpload(BlockUploader.java:166)
	at com.aliyun.odps.ship.upload.BlockUploader.upload(BlockUploader.java:98)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:211)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:208)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
ERROR: TunnelException - ErrorCode=Local Error, ErrorMessage=Block ID:0 Failed.
FAILED: error occurred while running tunnel command
>odps@ **my_account**>tunnel upload -dfp 'yyyyMMddHHmmss' ~/import.csv tbl_timestamp;

Upload session: 201903142006230475c00b02422511
Start upload:/home/username/import.csv
Using \n to split records
Upload in strict schema mode: true
Total bytes:15	 Split input to 1 blocks
2019-03-14 15:06:23	scan block: '1'
java.util.concurrent.ExecutionException: org.apache.commons.cli.ParseException: ERROR: format error - :1, TIMESTAMP:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at com.aliyun.odps.ship.upload.DshipUpload.uploadBlock(DshipUpload.java:224)
	at com.aliyun.odps.ship.upload.DshipUpload.upload(DshipUpload.java:166)
	at com.aliyun.odps.ship.DShip.runSubCommand(DShip.java:71)
	at com.aliyun.odps.ship.DShipCommand.run(DShipCommand.java:99)
	at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:151)
	at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:50)
	at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)
Caused by: org.apache.commons.cli.ParseException: ERROR: format error - :1, TIMESTAMP:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at com.aliyun.odps.ship.upload.BlockUploader.doUpload(BlockUploader.java:166)
	at com.aliyun.odps.ship.upload.BlockUploader.upload(BlockUploader.java:98)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:211)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:208)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
ERROR: TunnelException - ErrorCode=Local Error, ErrorMessage=Block ID:0 Failed.
FAILED: error occurred while running tunnel command
**odps@ **my_account**>set odps.sql.type.system.odps2=true;**
OK
**odps@ **my_account**>tunnel upload -dfp 'yyyyMMddHHmmss' ~/import.csv tbl_timestamp;**

Upload session: 201903142007161875c00b0242875e
Start upload:/home/username/import.csv
Using \n to split records
Upload in strict schema mode: true
Total bytes:15	 Split input to 1 blocks
2019-03-14 15:07:16	scan block: '1'
java.util.concurrent.ExecutionException: org.apache.commons.cli.ParseException: ERROR: format error - :1, TIMESTAMP:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at com.aliyun.odps.ship.upload.DshipUpload.uploadBlock(DshipUpload.java:224)
	at com.aliyun.odps.ship.upload.DshipUpload.upload(DshipUpload.java:166)
	at com.aliyun.odps.ship.DShip.runSubCommand(DShip.java:71)
	at com.aliyun.odps.ship.DShipCommand.run(DShipCommand.java:99)
	at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:151)
	at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:50)
	at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)
Caused by: org.apache.commons.cli.ParseException: ERROR: format error - :1, TIMESTAMP:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at com.aliyun.odps.ship.upload.BlockUploader.doUpload(BlockUploader.java:166)
	at com.aliyun.odps.ship.upload.BlockUploader.upload(BlockUploader.java:98)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:211)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:208)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
ERROR: TunnelException - ErrorCode=Local Error, ErrorMessage=Block ID:0 Failed.
FAILED: error occurred while running tunnel command
**>odps@ **my_account**>tunnel upload -dfp 'yyyyMMddHHmmss' ~/import.csv tbl_datetime;**

Upload session: 201903142007230475c00b02422665
Start upload:/home/username/import.csv
Using \n to split records
Upload in strict schema mode: true
Total bytes:15	 Split input to 1 blocks
2019-03-14 15:07:23	scan block: '1'
java.util.concurrent.ExecutionException: org.apache.commons.cli.ParseException: ERROR: format error - :1, DATETIME:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at com.aliyun.odps.ship.upload.DshipUpload.uploadBlock(DshipUpload.java:224)
	at com.aliyun.odps.ship.upload.DshipUpload.upload(DshipUpload.java:166)
	at com.aliyun.odps.ship.DShip.runSubCommand(DShip.java:71)
	at com.aliyun.odps.ship.DShipCommand.run(DShipCommand.java:99)
	at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:151)
	at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:50)
	at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)
Caused by: org.apache.commons.cli.ParseException: ERROR: format error - :1, DATETIME:'20110328035927'  Unparseable date: "20110328035927"content: 20110328035927
offset: 1

	at com.aliyun.odps.ship.upload.BlockUploader.doUpload(BlockUploader.java:166)
	at com.aliyun.odps.ship.upload.BlockUploader.upload(BlockUploader.java:98)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:211)
	at com.aliyun.odps.ship.upload.DshipUpload$1.call(DshipUpload.java:208)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
ERROR: TunnelException - ErrorCode=Local Error, ErrorMessage=Block ID:0 Failed.
FAILED: error occurred while running tunnel command

2nd try with successful insert, but adding 6 hours..

>username@localhost:~ $ echo "20110328000000" > import.csv
>username@localhost:~ $ odpscmd
>Aliyun ODPS Command Line Tool Version 0.29.1
>@Copyright 2017 Alibaba Cloud Computing Co., Ltd. All rights reserved.
>odps@ **my_account**>tunnel upload -dfp 'yyyyMMddHHmmss' ~/import.csv tbl_datetime;

Upload session: 201903142010581875c00b02428c1d
Start upload:/home/username/import.csv
Using \n to split records
Upload in strict schema mode: true
Total bytes:15	 Split input to 1 blocks
2019-03-14 15:10:58	scan block: '1'
2019-03-14 15:10:58	scan block complete, blockid=1
2019-03-14 15:10:58	upload block: '1'
2019-03-14 15:10:58	upload block complete, blockid=1
OK
>odps@ **my_account**>tunnel upload -dfp 'yyyyMMddHHmmss' ~/import.csv tbl_timestamp;

Upload session: 201903142011050475c00b02422b3a
Start upload:/home/username/import.csv
Using \n to split records
Upload in strict schema mode: true
Total bytes:15	 Split input to 1 blocks
2019-03-14 15:11:05	scan block: '1'
2019-03-14 15:11:05	scan block complete, blockid=1
2019-03-14 15:11:05	upload block: '1'
2019-03-14 15:11:05	upload block complete, blockid=1
OK
**odps@ **my_account**>select * from tbl_datetime;**

ID = 20190314121122715gl3h4dj
Log view:
http://logview.odps.aliyun.com/logview/?h=http://service.eu-central-1.maxcompute.aliyun.com/....
Job Queueing.
+------------+
| col        |
+------------+
| 2011-03-28 06:00:00 |
+------------+
**odps@ my_account>select * from tbl_timestamp;**

ID = 20190314121133301g93nrcj
Log view:
http://logview.odps.aliyun.com/logview/?h=http://service.eu-central-1.maxcompute.aliyun.com/....
Job Queueing.
+------+
| col  |
+------+
| 2011-03-28 06:00:00 |
+------+

An illegal reflective access operation has occurred

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.aliyun.openservices.odps.console.utils.CommandParserUtils (file:/Users/NoScripter/Downloads/pkgs/odps/lib/odpsconsole.jar) to constructor java.io.FileDescriptor(int)
WARNING: Please consider reporting this to the maintainers of com.aliyun.openservices.odps.console.utils.CommandParserUtils
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Aliyun ODPS Command Line Tool
Version 0.28.0

java.lang.NoClassDefFoundError

Exception in thread "main" java.lang.NoClassDefFoundError: com/aliyun/odps/compiler/parser/OdpsLexer
at com.aliyun.odps.sqa.commandapi.utils.SqlParserUtil.getSqlParserListener(SqlParserUtil.java:208)
at com.aliyun.odps.sqa.commandapi.utils.SqlParserUtil.isSelect(SqlParserUtil.java:175)
at com.aliyun.odps.sqa.SQLExecutorImpl.isSelect(SQLExecutorImpl.java:1347)
at com.aliyun.odps.sqa.SQLExecutorImpl.getResultSetInternal(SQLExecutorImpl.java:1013)
at com.aliyun.odps.sqa.SQLExecutorImpl.getResultSet(SQLExecutorImpl.java:667)
at com.aliyun.openservices.odps.console.InteractiveQueryCommand.getQueryResult(InteractiveQueryCommand.java:305)
at com.aliyun.openservices.odps.console.InteractiveQueryCommand.submitSubQuery(InteractiveQueryCommand.java:370)
at com.aliyun.openservices.odps.console.InteractiveQueryCommand.run(InteractiveQueryCommand.java:694)
at com.aliyun.openservices.odps.console.commands.AbstractCommand.execute(AbstractCommand.java:116)
at com.aliyun.openservices.odps.console.commands.InteractiveCommand.run(InteractiveCommand.java:108)
at com.aliyun.openservices.odps.console.commands.AbstractCommand.execute(AbstractCommand.java:116)
at com.aliyun.openservices.odps.console.commands.CompositeCommand.run(CompositeCommand.java:48)
at com.aliyun.openservices.odps.console.commands.AbstractCommand.execute(AbstractCommand.java:116)
at com.aliyun.openservices.odps.console.ODPSConsole.main(ODPSConsole.java:63)
Caused by: java.lang.ClassNotFoundException: com.aliyun.odps.compiler.parser.OdpsLexer
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 14 more

odpscmd create log dir in my HOME

when I use v0.29.0, odpscmd will create a log dir in my $HOME.
this would not happen with v0.27.1 if not running from the same dir where odps bin lies by ./odpscmd

how to prevent odpscmd making this log dir?

MacOS Intellij idea 中,始终无法 Add MaxCompute Project

Add MaxCompute Project时,选择odps_config.ini
会出现一个红色的错误提示:
Test connection fail: Can't bind xml to class com.aliyun.odps.Project$ProjectModel

以下是idea.log

2018-01-15 18:09:56,910 [ 934597] WARN - studio.component.util.OdpsUtil - [MaxCompute STUDIO]test project access fail com.aliyun.odps.OdpsException: Can't bind xml to class com.aliyun.odps.Project$ProjectModel at com.aliyun.odps.Project.reload(Project.java:232) at com.aliyun.odps.studio.component.util.OdpsUtil.testOdps(OdpsUtil.java:165) at com.aliyun.odps.studio.project.explorer.OdpsProjectConfigPanel.getProjectAccess(OdpsProjectConfigPanel.java:276) at com.aliyun.odps.studio.project.explorer.OdpsProjectConfigPanel.updateAccessProperties(OdpsProjectConfigPanel.java:258) at com.aliyun.odps.studio.project.explorer.OdpsProjectConfigPanel.access$100(OdpsProjectConfigPanel.java:42) at com.aliyun.odps.studio.project.explorer.OdpsProjectConfigPanel$1.insertUpdate(OdpsProjectConfigPanel.java:224) at javax.swing.text.AbstractDocument.fireInsertUpdate(AbstractDocument.java:201) at javax.swing.text.AbstractDocument.handleInsertString(AbstractDocument.java:748) at javax.swing.text.AbstractDocument.insertString(AbstractDocument.java:707) at javax.swing.text.PlainDocument.insertString(PlainDocument.java:130) at javax.swing.text.AbstractDocument.replace(AbstractDocument.java:669) at javax.swing.text.JTextComponent.setText(JTextComponent.java:1669) at com.intellij.ui.components.JBTextField.setText(JBTextField.java:62) at com.intellij.openapi.ui.TextComponentAccessor$1.setText(TextComponentAccessor.java:44) at com.intellij.openapi.ui.TextComponentAccessor$1.setText(TextComponentAccessor.java:36) at com.intellij.openapi.ui.ComponentWithBrowseButton$BrowseFolderActionListener.onFileChosen(ComponentWithBrowseButton.java:305) at com.intellij.openapi.fileChooser.FileChooser.lambda$chooseFile$0(FileChooser.java:151) at com.intellij.ui.mac.MacPathChooserDialog.choose(MacPathChooserDialog.java:174) at com.intellij.openapi.fileChooser.FileChooser.chooseFiles(FileChooser.java:114) at com.intellij.openapi.fileChooser.FileChooser.chooseFile(FileChooser.java:151) at com.intellij.openapi.ui.ComponentWithBrowseButton$BrowseFolderActionListener.actionPerformed(ComponentWithBrowseButton.java:269) at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2022) at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2348) at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:402) at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:259) at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:252) at java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:289) at java.awt.Component.processMouseEvent(Component.java:6541) at javax.swing.JComponent.processMouseEvent(JComponent.java:3324) at java.awt.Component.processEvent(Component.java:6306) at java.awt.Container.processEvent(Container.java:2237) at java.awt.Component.dispatchEventImpl(Component.java:4897) at java.awt.Container.dispatchEventImpl(Container.java:2295) at java.awt.Component.dispatchEvent(Component.java:4719) at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4889) at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4526) at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4467) at java.awt.Container.dispatchEventImpl(Container.java:2281) at java.awt.Window.dispatchEventImpl(Window.java:2746) at java.awt.Component.dispatchEvent(Component.java:4719) at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:764) at java.awt.EventQueue.access$500(EventQueue.java:98) at java.awt.EventQueue$3.run(EventQueue.java:715) at java.awt.EventQueue$3.run(EventQueue.java:709) at java.security.AccessController.doPrivileged(Native Method) at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80) at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:90) at java.awt.EventQueue$4.run(EventQueue.java:737) at java.awt.EventQueue$4.run(EventQueue.java:735) at java.security.AccessController.doPrivileged(Native Method) at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80) at java.awt.EventQueue.dispatchEvent(EventQueue.java:734) at com.intellij.ide.IdeEventQueue.defaultDispatchEvent(IdeEventQueue.java:822) at com.intellij.ide.IdeEventQueue._dispatchEvent(IdeEventQueue.java:646) at com.intellij.ide.IdeEventQueue.dispatchEvent(IdeEventQueue.java:366) at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201) at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116) at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:109) at java.awt.WaitDispatchSupport$2.run(WaitDispatchSupport.java:190) at java.awt.WaitDispatchSupport$4.run(WaitDispatchSupport.java:235) at java.awt.WaitDispatchSupport$4.run(WaitDispatchSupport.java:233) at java.security.AccessController.doPrivileged(Native Method) at java.awt.WaitDispatchSupport.enter(WaitDispatchSupport.java:233) at java.awt.Dialog.show(Dialog.java:1084) at com.intellij.openapi.ui.impl.DialogWrapperPeerImpl$MyDialog.show(DialogWrapperPeerImpl.java:734) at com.intellij.openapi.ui.impl.DialogWrapperPeerImpl.show(DialogWrapperPeerImpl.java:456) at com.intellij.openapi.ui.DialogWrapper.invokeShow(DialogWrapper.java:1696) at com.intellij.openapi.ui.DialogWrapper.show(DialogWrapper.java:1645) at com.intellij.openapi.ui.DialogBuilder.showImpl(DialogBuilder.java:88) at com.intellij.openapi.ui.DialogBuilder.show(DialogBuilder.java:55) at com.aliyun.odps.studio.intellij.project.OdpsProjectConfigurationForm.getProject(OdpsProjectConfigurationForm.java:46) at com.aliyun.odps.studio.intellij.project.ProjectExplorerWindow.getProjectInfoFromUserInput(ProjectExplorerWindow.java:209) at com.aliyun.odps.studio.project.explorer.ProjectExplorer.addNewProject(ProjectExplorer.java:127) at com.aliyun.odps.studio.project.explorer.ProjectExplorer.addNewProject(ProjectExplorer.java:135) at com.aliyun.odps.studio.project.explorer.ProjectExplorer$1.actionPerformed(ProjectExplorer.java:87) at com.aliyun.odps.studio.intellij.component.control.ActionAdapter$1.actionPerformed(ActionAdapter.java:17) at com.intellij.openapi.actionSystem.ex.ActionUtil$1.run(ActionUtil.java:220) at com.intellij.openapi.actionSystem.ex.ActionUtil.performActionDumbAware(ActionUtil.java:237) at com.intellij.openapi.actionSystem.impl.ActionButton.actionPerformed(ActionButton.java:193) at com.intellij.openapi.actionSystem.impl.ActionButton.performAction(ActionButton.java:151) at com.intellij.openapi.actionSystem.impl.ActionButton.processMouseEvent(ActionButton.java:344) at java.awt.Component.processEvent(Component.java:6306) at java.awt.Container.processEvent(Container.java:2237) at java.awt.Component.dispatchEventImpl(Component.java:4897) at java.awt.Container.dispatchEventImpl(Container.java:2295) at java.awt.Component.dispatchEvent(Component.java:4719) at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4889) at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4526) at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4467) at java.awt.Container.dispatchEventImpl(Container.java:2281) at java.awt.Window.dispatchEventImpl(Window.java:2746) at java.awt.Component.dispatchEvent(Component.java:4719) at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:764) at java.awt.EventQueue.access$500(EventQueue.java:98) at java.awt.EventQueue$3.run(EventQueue.java:715) at java.awt.EventQueue$3.run(EventQueue.java:709) at java.security.AccessController.doPrivileged(Native Method) at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80) at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:90) at java.awt.EventQueue$4.run(EventQueue.java:737) at java.awt.EventQueue$4.run(EventQueue.java:735) at java.security.AccessController.doPrivileged(Native Method) at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80) at java.awt.EventQueue.dispatchEvent(EventQueue.java:734) at com.intellij.ide.IdeEventQueue.defaultDispatchEvent(IdeEventQueue.java:822) at com.intellij.ide.IdeEventQueue._dispatchEvent(IdeEventQueue.java:646) at com.intellij.ide.IdeEventQueue.dispatchEvent(IdeEventQueue.java:366) at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201) at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116) at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105) at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101) at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:93) at java.awt.EventDispatchThread.run(EventDispatchThread.java:82) Caused by: java.lang.NullPointerException at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1439) at java.text.DateFormat.parse(DateFormat.java:364) at com.aliyun.odps.commons.util.DateUtils.parseRfc822Date(DateUtils.java:307) at com.aliyun.odps.Project.reload(Project.java:224) ... 112 more

Does odpscmd support using variables when executing "odpscm -f a.sql"?

I can use set var1 in Hive-SQL . can it be possible to use in odpscmd ?
Example :

-- a.sql
set tbl_name;
drop table ${tbl_name};

If I run "hive -f a.sql --define tbl_name=test_1" , then the sql will be "drop table test_1;"
If I run "hive -f a.sql --define tbl_name=test_2" , then the sql will be "drop table test_2;"

This is very convenient because I can generate different data by passing different parameters. How can I implement this feature in odpscmd?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.