Linux命令 xml

by · 2016年01月06日 · 1342 Words · ~3min reading time | Improve on

/t:loop" --follow "{.}?"
Check if your reddit letter is red:
Webscraping, combining CSS, XPath, JSONiq and automatically form evaluation:

xidel http://reddit.com -f "form(css('form.login-form')[1], {'user': '$your_username', 'passwd': '$your_password'})" -e "css('#mail')/@title"
Using the Reddit API:

xidel -d "user=$your_username&passwd=$your_password&api_type=json" https://ssl.reddit.com/api/login --method GET 'http://www.reddit.com/api/me.json' -e '($json).data.has_mail'
Use XQuery, to create a HTML table of odd and even numbers:

Windows cmd: xidel --xquery "

{for $i in 1 to 1000 return

{$i}	{if ($i mod 2 = 0) then 'even' else 'odd'}}

" --output-format xml
Linux/Powershell: xidel --xquery '{for $i in 1 to 1000 return

{$i}	{if ($i mod 2 = 0) then "even" else "odd"}}

' --output-format xml
(Xidel itself supports ' and "-quotes on all platforms, but ' does not escape <> in Windows' cmd, and " does not escape $ in the Linux shells)
Export variables to bash

eval "$(xidel http://site -e 'title:=//title' -e 'links:=//a/@href' --output-format bash)"

This sets the bash variable $title to the title of the page and $links becomes an array of all links there.
Reading JSON:

Read the 10th array element: xidel file.json -e '$json(10)'
Read all array elements: xidel file.json -e '$json()'
Read property "foo" and then "bar" with JSONiq notation: xidel file.json -e '$json("foo")("bar")'
Read property "foo" and then "bar" with dot notation: xidel file.json -e '($json).foo.bar'
Read property "foo" and then "bar" with XPath-like notation: xidel file.json -e '$json/foo/bar'
Mixed example: xidel file.json -e '$json("abc")()().xyz/(u,v)'
This would read all the numbers from e.g. {"abc": [[{"xyz": {"u": 1, "v": 2}}], [{"xyz": {"u": 3}}, {"xyz": {"u": 4}} ]]}.
All selectors are sequence-transparent, i.e. you can use the same selector to read something from one value as to read it from several values. Arrays are converted to sequences with ()
Convert table rows and columns to a CSV-like format:

xidel http://site -e '//tr / join(td, ",")'

join((...)) can generally be used to output some values in a single line. The function name is an abbreviation for the XPath function string-join. In the example tr / join calls join for every row.
Modify/Transform an HTML file, e.g. to mark all links as bold:

Windows cmd:
xidel --html your-file.html --xquery "transform(/, function($e) {
$e / if (name() = 'a') then

       <a style='{join((@style, 'font-weight: bold'), '; ')}'>{@* except @style, node()}</a>
    else .

})" > your-output-file.html
Linux/Powershell:
xidel --html your-file.html --xquery 'transform(/, function($e) {
$e / if (name() = "a") then

       <a style="{join((@style, "font-weight: bold"), "; ")}">{@* except @style, node()}</a>
    else .

})' > your-output-file.html

This example combines three important syntaxes:
transform(/, function($e) { .. }: This applies an anonymous function to every element in the HTML document, whereby that element is stored in variable $e and is replaced by the return value of the function.
{@* except @style, node()} : This creates a new a-element that has the same children, descendants and attributes as the current element, but removes the style-attribute.
style="{join((@style, "font-weight: bold"), "; ")}": This creates a new style-attribute by appending "font-weight: bold" to the old value of the attribute. A separating "; " is inserted, if (and only if) that attribute already existed.

You may also want to read the readme file of Xidel, the complete list of available functions, the documentation of my template language and XPath/XQuery 3.0 library. Or look at its results on the XQuery Testsuite.
Downloads

The following Xidel downloads are available on the sourceforge download page:

Operating System Filename Size
Windows: 32 Bit xidel-0.9.6.win32.zip 801.8 kB
Universal Linux: 64 Bit xidel-0.9.6.linux64.tar.gz 1.3 MB
Universal Linux: 32 Bit xidel-0.9.6.linux32.tar.gz 852.8 kB
Source: xidel-0.9.6.src.tar.gz 1.9 MB
Debian: 64 Bit xidel_0.9.6-1_amd64.deb 967.1 kB
Debian: 32 Bit xidel_0.9.6-1_i386.deb 659.8 kB
Mac 10.8 externally prebuilt version and compile instructions.

Usually you can just extract the zip/deb and call Xidel, or copy it to some place in your PATH,
because it consists of a single binary without any external dependencies, except the standard system libraries (i.e. Windows API or respectively libc).
However, for https connections on Linux openssl (including openssl-dev) and libcrypto are also required.

You can also test it online on a webpage or directly by sending a request to the cgi service like http://www.videlibri.de/cgi-bin/xidelcgi?data=&extract=//title&raw=true.

The source is stored in a mercurial repository together with the VideLibri source.

You can compile it with FreePascal and a regular expression library, preferably my copy of FLRE.
To compile it on the command line, call fpc xidel.pas and pass the paths to all directories using the -Fu option.
Alternatively, it can be compiled using Lazarus. For this install components/pascal/internettools.lpk and components/pascal/internettools_utf8.lpk in Lazarus, then open programs/internet/xidel/xidel.lpi and click on Run\Compile.

Pronounciation: To say the name "Xidel" in English, you say "excited" with a silent "C" and "D", followed by an "L". In German, you just say it as it is written.