2016-09-02 16:08:11 +00:00
|
|
|
xmppipe: stdio over XMPP
|
|
|
|
========================
|
|
|
|
|
2016-09-03 13:39:57 +00:00
|
|
|
xmppipe redirects stdin/stdout in a shell pipeline to an XMPP MUC
|
|
|
|
(XEP-0045). xmppipe supports flow control using stream management
|
2016-09-02 16:08:11 +00:00
|
|
|
(XEP-0198) and can optionally deal with overload by acting as a circuit
|
2016-09-07 14:22:58 +00:00
|
|
|
breaker or by discarding messages.
|
2016-09-02 16:08:11 +00:00
|
|
|
|
2016-09-05 13:04:14 +00:00
|
|
|
xmppipe works with line oriented tools like grep, sed and
|
|
|
|
awk by outputting each message as a newline terminated,
|
|
|
|
[percent-encoded](https://en.wikipedia.org/wiki/Percent-encoding) string.
|
2016-09-02 16:08:11 +00:00
|
|
|
|
2016-09-15 14:34:39 +00:00
|
|
|
xmppipe can be used in shell scripts to quickly write interactive bots
|
|
|
|
for monitoring systems or for sending alerts.
|
|
|
|
|
2016-09-02 16:08:11 +00:00
|
|
|
Usage
|
|
|
|
-----
|
|
|
|
|
|
|
|
xmppipe [*options*]
|
|
|
|
|
|
|
|
XMPPIPE_USERNAME=me@example.com
|
|
|
|
XMPPIPE_PASSWORD="password"
|
2018-07-22 13:57:35 +00:00
|
|
|
|
|
|
|
# default name: stdout-*hostname*-*uid*
|
|
|
|
xmpipe
|
|
|
|
xmppipe muc
|
|
|
|
xmppipe muc@example.com
|
2016-09-02 16:08:11 +00:00
|
|
|
|
2016-09-03 13:39:57 +00:00
|
|
|
Requirements
|
|
|
|
------------
|
|
|
|
|
|
|
|
* [libstrophe](https://github.com/strophe/libstrophe)
|
|
|
|
|
2017-07-03 13:45:01 +00:00
|
|
|
libstrophe 0.9.2 or later is required for [TLS certificate
|
|
|
|
verification](https://github.com/strophe/libstrophe/issues/100).
|
|
|
|
|
2016-09-03 13:39:57 +00:00
|
|
|
Build
|
|
|
|
-----
|
|
|
|
|
|
|
|
$ make
|
|
|
|
|
2017-02-22 15:27:02 +00:00
|
|
|
Tests
|
|
|
|
-----
|
|
|
|
|
|
|
|
# Install bats:
|
|
|
|
# apt-get install bats
|
|
|
|
# git clone https://github.com/sstephenson/bats.git # or from git
|
|
|
|
make test
|
|
|
|
|
2017-02-06 15:03:06 +00:00
|
|
|
Sandboxing
|
|
|
|
----------
|
|
|
|
|
2018-07-14 12:43:10 +00:00
|
|
|
xmppipe applies 2 sandboxes:
|
2017-07-03 13:45:01 +00:00
|
|
|
|
|
|
|
* a permissive "init" sandbox allowing network connections to the
|
|
|
|
XMPP server
|
2017-02-06 15:03:06 +00:00
|
|
|
|
2018-07-14 12:43:10 +00:00
|
|
|
* once the connection is established, a stricter "stdio" sandbox
|
|
|
|
limits the process to stdio
|
2017-02-06 15:03:06 +00:00
|
|
|
|
2017-07-03 13:45:01 +00:00
|
|
|
The effectiveness of the sandbox depends on which mechanism is used. By
|
|
|
|
default:
|
2017-02-06 15:03:06 +00:00
|
|
|
|
2017-04-19 14:28:47 +00:00
|
|
|
* Linux:
|
2017-02-06 15:03:06 +00:00
|
|
|
|
2017-04-19 14:28:47 +00:00
|
|
|
* init: seccomp(2)
|
|
|
|
* stdio: seccomp(2)
|
|
|
|
|
|
|
|
* OpenBSD:
|
|
|
|
|
|
|
|
* init: pledge(2)
|
|
|
|
* stdio: pledge(2)
|
|
|
|
|
|
|
|
* FreeBSD:
|
|
|
|
|
|
|
|
* init: setrlimit(2)
|
|
|
|
* stdio: setrlimit(2)/capsicum(4)
|
2017-02-06 15:03:06 +00:00
|
|
|
|
|
|
|
* other: setrlimit(2)
|
|
|
|
|
2017-04-19 14:28:47 +00:00
|
|
|
* init: setrlimit(2)
|
|
|
|
* stdio: setrlimit(2)
|
2017-02-06 15:03:06 +00:00
|
|
|
|
2018-07-14 12:43:10 +00:00
|
|
|
Selecting the sandbox is done at compile time. For example, to use the
|
|
|
|
"rlimit" sandbox:
|
2017-02-06 15:03:06 +00:00
|
|
|
|
2017-08-25 14:47:57 +00:00
|
|
|
XMPPIPE_SANDBOX=rlimit make
|
2017-02-06 15:03:06 +00:00
|
|
|
|
|
|
|
If a sandbox is interfering with normal operation, please open an issue.
|
|
|
|
To disable the sandbox, compile using the "null" sandbox:
|
|
|
|
|
2017-08-25 14:47:57 +00:00
|
|
|
XMPPIPE_SANDBOX=null make
|
2017-02-06 15:03:06 +00:00
|
|
|
|
2016-09-02 16:08:11 +00:00
|
|
|
Options
|
|
|
|
-------
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-u, --username *JID*
|
2016-09-02 16:08:11 +00:00
|
|
|
: XMPP username: takes precedence over environment variable
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-p, --password *password*
|
2016-09-02 16:08:11 +00:00
|
|
|
: XMPP password: takes precedence over environment variable
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-r, --resource *resource*
|
2016-09-02 16:08:11 +00:00
|
|
|
: XMPP resource, used as the nickname in the MUC
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-S, --subject *subject*
|
2016-09-02 16:08:11 +00:00
|
|
|
: XMPP MUC subject
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-a, --address *address:port*
|
2016-09-02 16:08:11 +00:00
|
|
|
: Specify the IP address and port of the XMPP server
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-d, --discard
|
2016-09-02 16:08:11 +00:00
|
|
|
: Discard stdin when MUC is empty
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-D, --discard-to-stdout
|
2016-09-02 16:08:11 +00:00
|
|
|
: Discard stdin and print to local stdout
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-e, --ignore-eof
|
2016-09-02 16:08:11 +00:00
|
|
|
: Ignore stdin EOF
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-s, --exit-when-empty
|
2016-09-02 16:08:11 +00:00
|
|
|
: Exit when MUC is empty
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-x, --base64
|
2016-09-02 16:08:11 +00:00
|
|
|
: Base64 encode/decode data
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-b, --buffer-size *size*
|
2016-09-02 16:08:11 +00:00
|
|
|
: Size of read buffer
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-I, --interval *interval*
|
2016-09-07 14:22:58 +00:00
|
|
|
: Request stream management status every interval messages
|
2016-09-02 16:08:11 +00:00
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-k, --keepalives *seconds*
|
2016-09-02 16:08:11 +00:00
|
|
|
: Periodically send a keepalive
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-K, --keepalive-failures *count*
|
2016-09-02 16:08:11 +00:00
|
|
|
: Number of keepalive failures before exiting
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-P, --poll-delay *ms*
|
2016-09-02 16:08:11 +00:00
|
|
|
: Poll delay
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
-v, --verbose
|
2016-09-02 16:08:11 +00:00
|
|
|
: Increase verbosity
|
|
|
|
|
2018-07-15 13:08:55 +00:00
|
|
|
--chat
|
|
|
|
: Use one to one chat
|
|
|
|
|
2017-07-09 12:33:06 +00:00
|
|
|
--no-tls-verify
|
|
|
|
: Disable TLS certificate verification
|
|
|
|
|
2016-09-05 13:04:14 +00:00
|
|
|
Decoding Percent-Encoded Strings
|
2016-09-03 13:39:57 +00:00
|
|
|
--------------------------------
|
2016-09-02 16:08:11 +00:00
|
|
|
|
|
|
|
Using bash:
|
|
|
|
|
2016-09-18 12:35:30 +00:00
|
|
|
~~~ shell
|
|
|
|
decode() {
|
|
|
|
printf '%b' "${1//%/\\x}"
|
|
|
|
}
|
2016-09-02 16:08:11 +00:00
|
|
|
~~~
|
|
|
|
|
|
|
|
Examples
|
|
|
|
--------
|
|
|
|
|
|
|
|
### Shell Bot
|
|
|
|
|
|
|
|
An interactive XMPP bot written in the shell:
|
|
|
|
|
|
|
|
~~~ shell
|
|
|
|
#!/bin/bash
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
set -o errexit
|
|
|
|
set -o nounset
|
2016-09-02 16:08:11 +00:00
|
|
|
set -o pipefail
|
|
|
|
|
2017-09-05 13:54:06 +00:00
|
|
|
trap cleanup EXIT
|
2016-09-02 16:08:11 +00:00
|
|
|
|
|
|
|
TMPDIR=$(mktemp -d)
|
|
|
|
|
|
|
|
in="$TMPDIR/stdin"
|
|
|
|
out="$TMPDIR/stdout"
|
|
|
|
|
|
|
|
mkfifo $in
|
|
|
|
mkfifo $out
|
|
|
|
|
|
|
|
cleanup() {
|
|
|
|
rm -rf $TMPDIR
|
|
|
|
}
|
|
|
|
|
|
|
|
decode() {
|
|
|
|
printf '%b' "${1//%/\\x}"
|
|
|
|
}
|
|
|
|
|
|
|
|
bot() {
|
2018-07-18 13:49:26 +00:00
|
|
|
while IFS=: read -r stanza type from to body; do
|
|
|
|
case "$stanza" in
|
2018-04-28 12:29:28 +00:00
|
|
|
m) ;;
|
|
|
|
|
2018-07-18 13:49:26 +00:00
|
|
|
p) decode "$stanza:$type:$from:$to" 1>&2
|
2018-04-28 12:29:28 +00:00
|
|
|
echo 1>&2
|
|
|
|
continue
|
|
|
|
;;
|
|
|
|
|
|
|
|
*) continue ;;
|
|
|
|
esac
|
|
|
|
|
|
|
|
USER="$(decode ${from#*/})"
|
2018-07-18 13:49:26 +00:00
|
|
|
MSG="$(decode ${body})"
|
2018-04-28 12:29:28 +00:00
|
|
|
|
|
|
|
case $MSG in
|
|
|
|
*"has set the subject to:"*) ;;
|
|
|
|
"sudo make me a sandwich")
|
|
|
|
echo "$USER: you're a sandwich"
|
|
|
|
;;
|
|
|
|
sudo*)
|
|
|
|
echo "I'm sorry, $USER. I'm afraid I can't do that."
|
|
|
|
;;
|
|
|
|
uptime)
|
|
|
|
uptime
|
|
|
|
;;
|
|
|
|
exit)
|
|
|
|
echo "exiting ..."
|
|
|
|
exit 0
|
|
|
|
;;
|
|
|
|
*)
|
|
|
|
echo "$MSG"
|
|
|
|
;;
|
|
|
|
esac
|
2016-09-02 16:08:11 +00:00
|
|
|
done < $out
|
|
|
|
}
|
|
|
|
|
|
|
|
bot > $in &
|
|
|
|
xmppipe "$@" <$in >$out
|
|
|
|
~~~
|
|
|
|
|
2018-07-12 13:52:51 +00:00
|
|
|
### Sending Notifications/Alerts
|
|
|
|
|
2018-07-14 12:43:10 +00:00
|
|
|
Start `xmppipe` attached to a pipe:
|
2018-07-12 13:52:51 +00:00
|
|
|
|
|
|
|
~~~ shell
|
|
|
|
mkfifo /tmp/xmpp
|
2018-07-14 12:43:10 +00:00
|
|
|
|
2018-07-12 13:52:51 +00:00
|
|
|
xmppipe -o groupchat <> /tmp/xmpp
|
|
|
|
~~~
|
|
|
|
|
2018-07-14 12:43:10 +00:00
|
|
|
Any data written to the pipe will be sent to the groupchat:
|
2018-07-12 13:52:51 +00:00
|
|
|
|
|
|
|
~~~ shell
|
|
|
|
echo "test" > /tmp/xmpp
|
|
|
|
|
|
|
|
df -h > /tmp/mpp
|
|
|
|
|
|
|
|
git diff > /tmp/xmpp
|
|
|
|
~~~
|
|
|
|
|
2016-09-02 16:08:11 +00:00
|
|
|
### SSH over XMPP
|
|
|
|
|
2016-09-03 13:39:57 +00:00
|
|
|
See [examples/ssh-over-xmpp](https://github.com/msantos/xmppipe/blob/master/examples/ssh-over-xmpp):
|
2016-09-02 16:08:11 +00:00
|
|
|
|
2016-09-05 13:04:14 +00:00
|
|
|
~~~ shell
|
2016-09-02 16:08:11 +00:00
|
|
|
# Server: has access to the destination SSH server
|
|
|
|
# ssh-over-xmpp server <conference> <IP address> <port>
|
|
|
|
ssh-over-xmpp server sshxmpp 1.2.3.4 22
|
|
|
|
|
|
|
|
## Client: has access to the XMPP server
|
|
|
|
ssh -o ProxyCommand="ssh-over-xmpp client sshxmpp" 127.0.0.1
|
|
|
|
~~~
|
|
|
|
|
2016-09-03 13:39:57 +00:00
|
|
|
### Stream Events from Riemann
|
|
|
|
|
|
|
|
This example will stream events from a query to an XMPP MUC using
|
|
|
|
[Riemann's](https://github.com/riemann/riemann) SSE interface. The events
|
|
|
|
are written to a named pipe to avoid buffering.
|
|
|
|
|
2016-09-05 13:04:14 +00:00
|
|
|
~~~ shell
|
2016-09-03 13:39:57 +00:00
|
|
|
mkfifo riemann
|
|
|
|
curl -s --get --data subscribe=true \
|
|
|
|
--data-urlencode 'query=(service ~= "^example")' \
|
|
|
|
http://example.com:80/index < /dev/null > riemann &
|
2017-09-05 13:54:06 +00:00
|
|
|
xmppipe --verbose --verbose \
|
2018-07-22 13:57:35 +00:00
|
|
|
--discard --subject "riemann events" muc < riemann
|
2016-09-03 13:39:57 +00:00
|
|
|
~~~
|
|
|
|
|
2018-05-04 14:25:52 +00:00
|
|
|
### Desktop Notifications
|
|
|
|
|
|
|
|
~~~ shell
|
|
|
|
#!/bin/bash
|
|
|
|
|
|
|
|
set -o errexit
|
|
|
|
set -o nounset
|
|
|
|
set -o pipefail
|
|
|
|
|
|
|
|
decode() {
|
|
|
|
printf '%b' "${1//%/\\x}"
|
|
|
|
}
|
|
|
|
|
|
|
|
MUC=""
|
|
|
|
|
|
|
|
while getopts ":o:" opt; do
|
|
|
|
case $opt in
|
|
|
|
o) MUC="$OPTARG" ;;
|
|
|
|
*) ;;
|
|
|
|
esac
|
|
|
|
done
|
|
|
|
|
2018-07-18 13:49:26 +00:00
|
|
|
xmppipe "$@" | while IFS=: read stanza type from to body; do
|
|
|
|
case "$stanza" in
|
|
|
|
m) notify-send "$MUC" "$(decode $body)" ;;
|
2018-05-04 14:25:52 +00:00
|
|
|
*) continue ;;
|
|
|
|
esac
|
|
|
|
done
|
|
|
|
~~~
|
|
|
|
|
2016-09-18 12:35:30 +00:00
|
|
|
### Mirror a terminal session using script(1)
|
|
|
|
|
|
|
|
* user
|
|
|
|
|
|
|
|
~~~ shell
|
|
|
|
#!/bin/bash
|
|
|
|
|
|
|
|
MUC=console
|
|
|
|
|
|
|
|
TMPDIR=$(mktemp -d)
|
|
|
|
FIFO=$TMPDIR/console
|
|
|
|
mkfifo $FIFO
|
|
|
|
|
|
|
|
stty cols 80 rows 24
|
2018-07-22 13:57:35 +00:00
|
|
|
(cat $FIFO | xmppipe --resource user -x $MUC) > /dev/null 2> $TMPDIR/stderr &
|
2016-09-18 12:35:30 +00:00
|
|
|
script -q -f $FIFO
|
|
|
|
~~~
|
|
|
|
|
|
|
|
* viewers
|
|
|
|
|
|
|
|
~~~ shell
|
|
|
|
#!/bin/bash
|
|
|
|
|
|
|
|
decode() {
|
|
|
|
printf '%b' "${1//%/\\x}"
|
|
|
|
}
|
|
|
|
|
|
|
|
stty cols 80 rows 24
|
2018-07-22 13:57:35 +00:00
|
|
|
xmppipe --resource viewer --base64 console | \
|
2018-05-23 14:05:19 +00:00
|
|
|
while IFS=: read -r x s f t m; do
|
|
|
|
[ "$m" = "m" ] && decode "$m"
|
2018-04-28 12:29:28 +00:00
|
|
|
done
|
2016-09-18 12:35:30 +00:00
|
|
|
~~~
|
2016-09-02 16:08:11 +00:00
|
|
|
|
2016-09-03 13:39:57 +00:00
|
|
|
### Mirror a terminal session to a web page
|
2016-09-02 16:08:11 +00:00
|
|
|
|
|
|
|
Environment Variables
|
|
|
|
---------------------
|
|
|
|
|
|
|
|
* XMPPIPE_USERNAME: XMPP jid
|
|
|
|
|
|
|
|
* XMPPIPE_PASSWORD: XMPP password
|
|
|
|
|
|
|
|
Format
|
|
|
|
------
|
|
|
|
|
|
|
|
Each message is terminated by a new line. Message fields are separated by
|
|
|
|
":" and percent encoded.
|
|
|
|
|
|
|
|
### Presence
|
|
|
|
|
|
|
|
p:<available|unavailable>:<to jid>:<from jid>
|
|
|
|
|
|
|
|
Example:
|
|
|
|
|
2016-09-05 13:04:14 +00:00
|
|
|
p:available:test@muc.example.com/xmppipe:occupant@example.com/1234
|
2016-09-02 16:08:11 +00:00
|
|
|
|
|
|
|
### Message
|
|
|
|
|
2018-08-04 13:06:52 +00:00
|
|
|
m:<chat|groupchat|normal|headline>:<from jid>:<to jid>:<message body>
|
2016-09-02 16:08:11 +00:00
|
|
|
|
|
|
|
Example:
|
|
|
|
|
2016-09-05 13:04:14 +00:00
|
|
|
m:groupchat:test@muc.example.com/mobile:user1@example.com/1234:Hello
|
|
|
|
m:chat:user1@example.com/mobile:user2@example.com:Message%20goes%20here
|
2016-09-02 16:08:11 +00:00
|
|
|
|
2016-09-15 14:34:39 +00:00
|
|
|
Compatibility
|
|
|
|
-------------
|
|
|
|
|
|
|
|
Tested with ejabberd and mongooseim.
|
|
|
|
|
2017-01-26 15:32:10 +00:00
|
|
|
License
|
|
|
|
-------
|
|
|
|
|
2018-07-12 13:52:51 +00:00
|
|
|
Copyright (c) 2015-2018, Michael Santos <michael.santos@gmail.com>
|
2017-01-26 15:32:10 +00:00
|
|
|
|
|
|
|
Permission to use, copy, modify, and/or distribute this software for any
|
|
|
|
purpose with or without fee is hereby granted, provided that the above
|
|
|
|
copyright notice and this permission notice appear in all copies.
|
|
|
|
|
|
|
|
THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES
|
|
|
|
WITH REGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF
|
|
|
|
MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR
|
|
|
|
ANY SPECIAL, DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES
|
|
|
|
WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN
|
|
|
|
ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF
|
|
|
|
OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
|
|
|
|
|
2016-09-02 16:08:11 +00:00
|
|
|
TODO
|
|
|
|
----
|
|
|
|
|
2017-07-03 13:45:01 +00:00
|
|
|
* support [XEP-0384: OMEMO Encryption](https://xmpp.org/extensions/xep-0384.html)
|
2017-01-26 15:32:10 +00:00
|
|
|
|
2017-07-03 13:45:01 +00:00
|
|
|
* support alternative input modes
|
2017-01-26 15:32:10 +00:00
|
|
|
|
2017-07-03 13:45:01 +00:00
|
|
|
Add a command line argument to enable various input modes. The default
|
|
|
|
mode converts stdin to a message body.
|
|
|
|
|
|
|
|
"formatted" mode takes the same input as the output. For example,
|
|
|
|
to send a chat message:
|
|
|
|
|
|
|
|
echo 'm:chat:user1@example.com/mobile:user2@example.com:Message%20goes%20here' | xmppipe
|
|
|
|
|
|
|
|
A "raw" mode could also be added: XML input/output.
|