How to: Unlimited Bash/shell history?

Question

Is there a way to define an unlimited history in Bash ?

Answer 1

Add this to your .bashrc (Linux) or .bash_profile (MacOS):

export HISTFILESIZE=
export HISTSIZE=

There you go, unlimited history. Currently I have 27000 entries :)

From man bash:

If HISTFILESIZE is not set, no truncation is performed.

That means .bash_history is never truncated

Also the same seems to apply to HISTSIZE, although I couldn't find that documented.

Another neat feature I'm going to try is this:

If the HISTTIMEFORMAT variable is set, time stamps are written to the history file, marked with the history comment character, so they may be preserved across shell sessions, like the following:

export HISTTIMEFORMAT="%F %T "

Let me know if you have tried that already...

Answer 2

After many large, ugly iterations and weird edge cases over the years, I now have a concise section of my .bashrc dedicated to this.

First, you must comment out or remove this section of your .bashrc (default for Ubuntu). If you don't, then certain environments (like running screen sessions) will still truncate your history:

# for setting history length see HISTSIZE and HISTFILESIZE in bash(1)
# HISTSIZE=1000
# HISTFILESIZE=2000

Second, add this to the bottom of your .bashrc:

# Eternal bash history.
# ---------------------
# Undocumented feature which sets the size to "unlimited".
# https://stackoverflow.com/questions/9457233/unlimited-bash-history
export HISTFILESIZE=
export HISTSIZE=
export HISTTIMEFORMAT="[%F %T] "
# Change the file location because certain bash sessions truncate .bash_history file upon close.
# http://superuser.com/questions/575479/bash-history-truncated-to-500-lines-on-each-login
export HISTFILE=~/.bash_eternal_history
# Force prompt to write history after every command.
# http://superuser.com/questions/20900/bash-history-loss
PROMPT_COMMAND="history -a; $PROMPT_COMMAND"

Note: every command is written immediately after it's run, so if you accidentally paste a password you cannot just "kill -9 %%" to avoid the history write, you'll need to remove it manually.

Also note that each bash session will load the full history file in memory, but even if your history file grows to 10MB (which will take a long, long time) you won't notice much of an effect on your bash startup time.

Answer 3

Include in ~/.bashrc:

# append a session's history on shell exit
shopt -s histappend
export HISTFILESIZE=
export HISTSIZE=

This answer satisfies the following criteria:

1. a separate master history (no session can interrupt your history)

2. automatic history writing (no hotkeys)

3. infrequent writes (no appending after each command)

background

On interactive startup, if $HISTFILESIZE is set to a number, bash truncates $HISTFILE to that number. On interactive close, if the shell option histappend is set, bash appends $HISTSIZE lines to $HISTFILE, otherwise it overwrites $HISTFILE.

tips for OSX (Terminal)

Every time a tab is created in Terminal, ~/.bash_profile is read, which means bash doesn't go on to read your ~/.bashrc. Add the following line to your ~/etc/bash_profile:

# if bashrc has content, source it
[[ -s ~/.bashrc ]] && . ~/.bashrc

tips for screen

If you use screen, your configuration file is ~/.screenrc. If you want screen to record history, you just need to set it to use a login shell which will source your bash startup files (and record your history).

# use bash, make it a login shell
defshell -bash

Answer 4

A different concept (may not be applicable) but you can have unlimited history when using shell-sink.

Answer 5

Sorry for may be late answer, but for completeness: at me (Debian Bullseye) works

HISTSIZE=-1 
HISTFILESIZE=-1

Answer 6

I never could get increased history to work on my Mac so I created my own.
I added this code to my .zshrc, pretty sure it would work in .bashrc as well. It captures every command you do and writes it to the file, with a line number.

It gives you a new command hist on the command line. You can pass it hist -10 and it will show the last 10 lines of your new history file. Just hist will default to 20 lines.

history_file=~/Documents/history
precmd() {
    local last_command=$(history | tail -n 1 | sed 's/^[[:space:]]*[0-9]*[[:space:]]*//')
    local counter=1

    # If the file exists and is not empty, get the last number and increment it
    if [[ -s $history_file ]]; then
        counter=$(( $(tail -n 1 "$history_file" | awk '{print $1}') + 1 ))
    fi

    echo "$counter $last_command" >> "$history_file"
}

hist() {
    local num_lines=20  # default number of lines

    # Check if an argument is provided and it's a valid number
    if [[ $# -eq 1 && $1 =~ ^-?[0-9]+$ ]]; then
        num_lines=$1
    fi

    # Display the specified number of lines from the history file
    tail -n $num_lines "$history_file"
}