glob (programming)

In computer programming, in particular in a Unix-like environment, glob patterns specify sets of filenames with wildcard characters. For example, the Unix command mv *.txt textfiles/ moves (mv) all files with names ending in .txt from the current directory to the directory textfiles. Here, * is a wildcard standing for "any string of characters" and *.txt is a glob pattern. The other common wildcard is the question mark (?), which stands for one character.

Origin

The command interpreters of the early versions of Unix (1st through 6th Editions, 1969–75) relied on a separate program to expand wildcard characters in unquoted arguments to a command: /etc/glob. That program performed the expansion and supplied the expanded list of file paths to the command for execution. Its name is an abbreviation for "global command". Later, this functionality was provided as a library function, glob(), used by programs such as the shell.

Technical

Unix shell globbing operates by parameter expansion – the glob pattern (e.g., *.log) is expanded and replaced by the list of all matches. For example, if a directory contains two files, a.log and b.log then the command cat *.log will be expanded by the shell to cat a.log b.log which is then evaluated (in this case, displaying the files). The order of arguments to a command often matters – for example, cat a.log b.log prints first a.log and then b.log, while cat b.log a.log prints first b.log and then a.log. Thus, while "filenames that match the pattern" is an (unordered) set, the actual expanded list of matching files is an ordered list, a sequence, and thus an order must be chosen, conventionally alphabetical order, however defined by the shell.

Implementations

Unix shells such as Bash, tcsh, and zsh provide globbing on filenames at the command line and in shell scripts.

The Windows command interpreter cmd.exe relies on a runtime function in applications to perform globbing. Windows PowerShell Cmdlets support globbing.

The term "glob" is also used to refer more generally to limited pattern-matching facilities of this kind, in other contexts:

• D has a globMatch function in the std.path module.
• Go has a Glob function in the filepath package.
• Java has a Files class containing methods that operate on glob patterns.
• Haskell has a Glob package with the main module System.FilePath.Glob. The pattern syntax is based on a subset of Zsh’s. It tries to optimize the given pattern and should be noticeably faster than a naïve character-by-character matcher.
• Perl has both a glob function (as discussed in Larry Wall's book Programming Perl) and a Glob extension which mimics the BSD glob routine. Perl's angle brackets can be used to glob as well: <*.log>.
• PHP has a glob function.
• Python has a glob module in the standard library which performs wildcard pattern matching on filenames, and an fnmatch module with functions for matching strings or filtering lists based on these same wildcard patterns Guido van Rossum, author of the Python programming language, wrote and contributed a glob() routine to BSD Unix in 1986. There were previous implementations of glob, e.g., in the ex and ftp programs in previous releases of BSD.
• Ruby has a glob method for the Dir class which performs wildcard pattern matching on filenames. Several libraries such as Rant and Rake provide a FileList class which has a glob method or use the method FileList.[] identically.
• SQLite has a GLOB function.
• Tcl contains both true regular expression matching facilities and a more limited kind of pattern matching often described as globbing.

Syntax

The most common wildcards are *, ?, and [...].

Wildcard	Description	Example	Matches	Does not match
*	matches any number of any characters including none	Law*	Law, Laws, or Lawyer
		*Law*	Law, GrokLaw, or Lawyer.
?	matches any single character	?at	Cat, cat, Bat or bat	at
[abc]	matches one character given in the bracket	[CB]at	Cat or Bat	cat or bat
[a-z]	matches one character from the range given in the bracket	Letter[0-9]	Letter0, Letter1 etc.	Letters or Letter

In all cases the path separator character (/ on unix or \ on windows) will never be matched.

Unix

On Linux and Posix systems *, ? is defined as above while [...] has two additional meanings:

Wildcard	Description	Example	Matches	Does not match
[!abc]	matches one character that is not given in the bracket	[!C]at	Bat, bat, or cat	Cat
[!a-z]	matches one character that is not from the range given in the bracket	Letter[!3-5]	Letter1, Letter2 etc.	Letter3, Letter4 or Letter5

Some shells (like the C shell) support additional syntax including alternation or brace expansion, also known as extended globbing.

Windows PowerShell

Windows PowerShell has all the common syntax defined as stated above without any additions.

DOS COMMAND.COM and Windows cmd.exe

COMMAND.COM and cmd.exe have most of the common syntax with some limitations: There is no [...] and the * may only appear at the end of the pattern, not at the beginning.

SQL

The SQL LIKE operator has an equivalent of ? and *. There is no equivalent of [...].

Common wildcard	SQL wildcard
?	_
*	%

Standard SQL uses a glob-like syntax for simple string matching in its LIKE operator. The percent sign (%) matches zero or more characters, and the underscore matches exactly one character. The term "glob" is not generally used in the SQL community, however. Many implementations of SQL have extended the LIKE operator to allow a richer pattern-matching language incorporating elements of regular expressions.

Some proprietary extensions such as Transact-SQL provide the [...] functionality, e.g., [characters] and [^characters].

Compared to Regular Expressions

Globs do not include syntax for the Kleene star which allows multiple repetitions of the preceding part of the expression; thus they are not considered regular expressions, which can describe the full set of regular languages over any given finite alphabet.

See also

• Regular expression
• Wildcard character
• Wildmat