-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
popcorny
committed
Apr 19, 2016
0 parents
commit bf91034
Showing
11 changed files
with
1,120 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,122 @@ | ||
# AzureKit | ||
*azurekit* is a CLI toolkit to interact with [microsoft azure blob storage](https://azure.microsoft.com/en-us/documentation/articles/storage-introduction/#blob-storage). There are several commands included. | ||
|
||
1. azruecat - Output a blob content to stdout | ||
2. azuresink - Pipe stdin to a azure storage blob. | ||
3. azuresas - Generate the Shared-Acess-Signature to stdout. | ||
|
||
# Requirement | ||
Java 6 or higher | ||
|
||
# Getting Start | ||
|
||
1. First, you must prepare your [Connection String](https://azure.microsoft.com/en-us/documentation/articles/storage-configure-connection-string/) for your storage account. The format is | ||
|
||
```bash | ||
DefaultEndpointsProtocol=[http|https];AccountName=myAccountName;AccountKey=myAccountKey | ||
``` | ||
|
||
2. Download from [release](https://github.com/tenmax/azurekit/releases). | ||
|
||
3. Run the commands. | ||
|
||
## AzureCat | ||
|
||
Usage | ||
|
||
1. Print a resource | ||
|
||
```bash | ||
azurecat https://<account-name>.blob.core.windows.net/<container-name>/<blob-path> | ||
``` | ||
|
||
2. Concatenate and print the resources with prefix | ||
|
||
```bash | ||
azurecat --prefix https://<account-name>.blob.core.windows.net/<container-name>/<blob-prefix> | ||
``` | ||
3. Concatenate and print the resources with prefix and the resource should match the postfix | ||
|
||
```bash | ||
azurecat --prefix --postfix csv https://<account-name>.blob.core.windows.net/<container-name>/<blob-prefix> | ||
``` | ||
|
||
4. Decode the resource by gzip compression format. | ||
|
||
```bash | ||
azurecat -z --prefix --postfix gz https://<account-name>.blob.core.windows.net/<container-name>/<blob-prefix> | ||
``` | ||
|
||
The full help for `azurecat` | ||
|
||
``` | ||
usage: azurecat [-c <connection-string>] <blob-uri> | ||
-b <arg> Set the read buffer size in KBytes | ||
-c <arg> The connection string | ||
-h The help information | ||
--postfix <string> keep only the blob which has the path with the | ||
specified postfix. The postfix only be used while | ||
prefix is used. | ||
--prefix cat all the blobs with the prefix | ||
-v The version | ||
-z The gzip format | ||
``` | ||
|
||
|
||
## AzureSink | ||
|
||
Usage | ||
|
||
1. Upload the content 'helloword' to the given path | ||
|
||
```bash | ||
echo 'helloworld' | azuresink -c <connection-string> http://<account-name>.blob.core.windows.net/<container-name>/<blob-path> | ||
``` | ||
|
||
The full help for `azuresink` | ||
|
||
``` | ||
usage: azuresink [-c <connection-string>] <blob-uri> | ||
-c <arg> The connection string | ||
-f Force upload even the blob exists | ||
-h The help information | ||
-v The version | ||
``` | ||
|
||
|
||
## AzureSAS | ||
|
||
Usage | ||
|
||
1. Get the SAS url with 1 day expiration duration. | ||
|
||
```bash | ||
azuresas -c <connection-string> http://<account-name>.blob.core.windows.net/<container-name>/<blob-path> | ||
``` | ||
|
||
The full help for `azuresas` | ||
|
||
``` | ||
usage: azuresas [-c <connection-string>] -e <seconds> <blob-uri> | ||
-c <arg> The connection string | ||
-e <arg> The seconds to expired. (default=86400s) | ||
-h The help information | ||
-v The version | ||
``` | ||
|
||
# Configuration File | ||
|
||
You can put your connection strings at `~/.azure/storagekeys` line by line | ||
|
||
Here is the example. | ||
|
||
``` | ||
DefaultEndpointsProtocol=https;AccountName= myAccountName1;AccountKey=myAccountKey1 | ||
DefaultEndpointsProtocol=https;AccountName= myAccountName2;AccountKey=myAccountKey2 | ||
``` | ||
|
||
then, you can use the resource directly without connection string specified. | ||
|
||
```bash | ||
echo 'helloworld' | azurecat https://<account-name>.blob.core.windows.net/<container-name>/<blob-path> | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,45 @@ | ||
apply plugin: 'java' | ||
apply plugin: 'application' | ||
repositories { | ||
jcenter() | ||
} | ||
|
||
mainClassName = 'io.tenmax.azurekit.AzureCat' | ||
|
||
|
||
startScripts { | ||
applicationName = 'azurecat' | ||
} | ||
|
||
task createAllStartScripts() << { | ||
} | ||
|
||
def scripts = [ 'azurecat': 'io.tenmax.azurekit.AzureCat', | ||
'azuresink':'io.tenmax.azurekit.AzureSink', | ||
'azuresas':'io.tenmax.azurekit.AzureSAS' | ||
] | ||
scripts.each() { scriptName, className -> | ||
def t = tasks.create(name: scriptName+'StartScript', type: CreateStartScripts) { | ||
mainClassName = className | ||
applicationName = scriptName | ||
outputDir = new File(project.buildDir, 'scripts') | ||
classpath = jar.outputs.files + project.configurations.runtime | ||
} | ||
applicationDistribution.into("bin") { | ||
from(t) | ||
fileMode = 0755 | ||
} | ||
createAllStartScripts.dependsOn(t) | ||
} | ||
|
||
sourceCompatibility = '1.6' | ||
targetCompatibility = '1.6' | ||
|
||
dependencies { | ||
compile 'org.slf4j:slf4j-api:1.7.7' | ||
compile 'com.microsoft.azure:azure-storage:3.0.0' | ||
compile 'commons-cli:commons-cli:1.3.1' | ||
compile 'commons-io:commons-io:2.4' | ||
|
||
testCompile 'junit:junit:4.12' | ||
} |
Binary file not shown.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
#Fri Aug 28 21:32:52 CST 2015 | ||
distributionBase=GRADLE_USER_HOME | ||
distributionPath=wrapper/dists | ||
zipStoreBase=GRADLE_USER_HOME | ||
zipStorePath=wrapper/dists | ||
distributionUrl=https\://services.gradle.org/distributions/gradle-2.3-bin.zip |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,164 @@ | ||
#!/usr/bin/env bash | ||
|
||
############################################################################## | ||
## | ||
## Gradle start up script for UN*X | ||
## | ||
############################################################################## | ||
|
||
# Add default JVM options here. You can also use JAVA_OPTS and GRADLE_OPTS to pass JVM options to this script. | ||
DEFAULT_JVM_OPTS="" | ||
|
||
APP_NAME="Gradle" | ||
APP_BASE_NAME=`basename "$0"` | ||
|
||
# Use the maximum available, or set MAX_FD != -1 to use that value. | ||
MAX_FD="maximum" | ||
|
||
warn ( ) { | ||
echo "$*" | ||
} | ||
|
||
die ( ) { | ||
echo | ||
echo "$*" | ||
echo | ||
exit 1 | ||
} | ||
|
||
# OS specific support (must be 'true' or 'false'). | ||
cygwin=false | ||
msys=false | ||
darwin=false | ||
case "`uname`" in | ||
CYGWIN* ) | ||
cygwin=true | ||
;; | ||
Darwin* ) | ||
darwin=true | ||
;; | ||
MINGW* ) | ||
msys=true | ||
;; | ||
esac | ||
|
||
# For Cygwin, ensure paths are in UNIX format before anything is touched. | ||
if $cygwin ; then | ||
[ -n "$JAVA_HOME" ] && JAVA_HOME=`cygpath --unix "$JAVA_HOME"` | ||
fi | ||
|
||
# Attempt to set APP_HOME | ||
# Resolve links: $0 may be a link | ||
PRG="$0" | ||
# Need this for relative symlinks. | ||
while [ -h "$PRG" ] ; do | ||
ls=`ls -ld "$PRG"` | ||
link=`expr "$ls" : '.*-> \(.*\)$'` | ||
if expr "$link" : '/.*' > /dev/null; then | ||
PRG="$link" | ||
else | ||
PRG=`dirname "$PRG"`"/$link" | ||
fi | ||
done | ||
SAVED="`pwd`" | ||
cd "`dirname \"$PRG\"`/" >&- | ||
APP_HOME="`pwd -P`" | ||
cd "$SAVED" >&- | ||
|
||
CLASSPATH=$APP_HOME/gradle/wrapper/gradle-wrapper.jar | ||
|
||
# Determine the Java command to use to start the JVM. | ||
if [ -n "$JAVA_HOME" ] ; then | ||
if [ -x "$JAVA_HOME/jre/sh/java" ] ; then | ||
# IBM's JDK on AIX uses strange locations for the executables | ||
JAVACMD="$JAVA_HOME/jre/sh/java" | ||
else | ||
JAVACMD="$JAVA_HOME/bin/java" | ||
fi | ||
if [ ! -x "$JAVACMD" ] ; then | ||
die "ERROR: JAVA_HOME is set to an invalid directory: $JAVA_HOME | ||
Please set the JAVA_HOME variable in your environment to match the | ||
location of your Java installation." | ||
fi | ||
else | ||
JAVACMD="java" | ||
which java >/dev/null 2>&1 || die "ERROR: JAVA_HOME is not set and no 'java' command could be found in your PATH. | ||
Please set the JAVA_HOME variable in your environment to match the | ||
location of your Java installation." | ||
fi | ||
|
||
# Increase the maximum file descriptors if we can. | ||
if [ "$cygwin" = "false" -a "$darwin" = "false" ] ; then | ||
MAX_FD_LIMIT=`ulimit -H -n` | ||
if [ $? -eq 0 ] ; then | ||
if [ "$MAX_FD" = "maximum" -o "$MAX_FD" = "max" ] ; then | ||
MAX_FD="$MAX_FD_LIMIT" | ||
fi | ||
ulimit -n $MAX_FD | ||
if [ $? -ne 0 ] ; then | ||
warn "Could not set maximum file descriptor limit: $MAX_FD" | ||
fi | ||
else | ||
warn "Could not query maximum file descriptor limit: $MAX_FD_LIMIT" | ||
fi | ||
fi | ||
|
||
# For Darwin, add options to specify how the application appears in the dock | ||
if $darwin; then | ||
GRADLE_OPTS="$GRADLE_OPTS \"-Xdock:name=$APP_NAME\" \"-Xdock:icon=$APP_HOME/media/gradle.icns\"" | ||
fi | ||
|
||
# For Cygwin, switch paths to Windows format before running java | ||
if $cygwin ; then | ||
APP_HOME=`cygpath --path --mixed "$APP_HOME"` | ||
CLASSPATH=`cygpath --path --mixed "$CLASSPATH"` | ||
|
||
# We build the pattern for arguments to be converted via cygpath | ||
ROOTDIRSRAW=`find -L / -maxdepth 1 -mindepth 1 -type d 2>/dev/null` | ||
SEP="" | ||
for dir in $ROOTDIRSRAW ; do | ||
ROOTDIRS="$ROOTDIRS$SEP$dir" | ||
SEP="|" | ||
done | ||
OURCYGPATTERN="(^($ROOTDIRS))" | ||
# Add a user-defined pattern to the cygpath arguments | ||
if [ "$GRADLE_CYGPATTERN" != "" ] ; then | ||
OURCYGPATTERN="$OURCYGPATTERN|($GRADLE_CYGPATTERN)" | ||
fi | ||
# Now convert the arguments - kludge to limit ourselves to /bin/sh | ||
i=0 | ||
for arg in "$@" ; do | ||
CHECK=`echo "$arg"|egrep -c "$OURCYGPATTERN" -` | ||
CHECK2=`echo "$arg"|egrep -c "^-"` ### Determine if an option | ||
|
||
if [ $CHECK -ne 0 ] && [ $CHECK2 -eq 0 ] ; then ### Added a condition | ||
eval `echo args$i`=`cygpath --path --ignore --mixed "$arg"` | ||
else | ||
eval `echo args$i`="\"$arg\"" | ||
fi | ||
i=$((i+1)) | ||
done | ||
case $i in | ||
(0) set -- ;; | ||
(1) set -- "$args0" ;; | ||
(2) set -- "$args0" "$args1" ;; | ||
(3) set -- "$args0" "$args1" "$args2" ;; | ||
(4) set -- "$args0" "$args1" "$args2" "$args3" ;; | ||
(5) set -- "$args0" "$args1" "$args2" "$args3" "$args4" ;; | ||
(6) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" ;; | ||
(7) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" ;; | ||
(8) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" "$args7" ;; | ||
(9) set -- "$args0" "$args1" "$args2" "$args3" "$args4" "$args5" "$args6" "$args7" "$args8" ;; | ||
esac | ||
fi | ||
|
||
# Split up the JVM_OPTS And GRADLE_OPTS values into an array, following the shell quoting and substitution rules | ||
function splitJvmOpts() { | ||
JVM_OPTS=("$@") | ||
} | ||
eval splitJvmOpts $DEFAULT_JVM_OPTS $JAVA_OPTS $GRADLE_OPTS | ||
JVM_OPTS[${#JVM_OPTS[*]}]="-Dorg.gradle.appname=$APP_BASE_NAME" | ||
|
||
exec "$JAVACMD" "${JVM_OPTS[@]}" -classpath "$CLASSPATH" org.gradle.wrapper.GradleWrapperMain "$@" |
Oops, something went wrong.