JavaScript is not currently enabled, but is required for full CodeSonar manual search and browse functionality.

If you are viewing this file in your hub's Web GUI, enable JavaScript in your browser: you will also need it for GUI functionality.

If you opened this file directly from disk, your browser may be directly suppressing JavaScript functionality: certain browsers perform this suppression on local files (but not files delivered by web servers) for security reasons.

CodeSonar® 9.2p0 CONFIDENTIAL CodeSecure Inc

Task: Delete a Project with a Shell Script

You can use a script to delete an existing project from the command line.

Deleting a project from the hub removes all the information associated with the project:

Because removing a project deletes all this information, it is generally not recommended. Exceptions are the following cases.

This task provides a shell script for deleting a specified project, along with some suggestions for modifying the script to suit your needs.

This page does not describe how to automate script deployment: we strongly advise against deleting projects automatically.

For other scripting options, see:


Permissions Required

The script requires that special user Anonymous has the following permissions for the project P and its analyses.

If you will be extending the script to derive the project ID from an analysis directory for some analysis A of the project, you will also need the following permissions for A.

See Modifying the Script for information on modifying the script to specify credentials for a non-Anonymous user with the required permissions.

Other Requirements

Use the cURL shipped with CodeSonar: $CSONAR/third-party/curl/inst/bin/curl, where $CSONAR is the CodeSonar installation directory. Either:

The Deletion Script

The following script will delete

#! /bin/sh -e


if [ $# -ne 2 ]; then
    echo "Usage: $0 HUB PROJECT_ID"
    exit 1
fi

HUB=$1
PROJECT_ID=$2
CURL_CMD=curl

del_project(){
   "$CURL_CMD" -L --cookie-jar cookies.txt -d remove_project_id="$1" "$2"
}

del_project "${PROJECT_ID}" "${HUB}"

This shell script uses an HTTP POST request to perform the deletion: the POST request is for the hub Home page and must specify remove_project_id=pid, where pid is the project ID of the project to be deleted. It outputs the HTML landing page that reports successful deletion.

The hub functionality for deleting an analysis entails several HTTP redirects across a single session. When you are using an anonymous session, as here, it must be tracked using cookies. The script uses cURL options to ensure that the redirects and cookies are properly accounted for:

Inspect the HTML source for a Project page to see the remove_project_form element and how its attributes and sub-elements correspond to the HTTP POST request constructed by the script.

Using the Script

To use this script with your hub, do the following.

  1. Copy delete_project.sh to a suitable directory. The remainder of these instructions will refer to this directory as rundir.

    Make sure you have full file permissions in rundir, and that using file rundir/cookies.txt to manage cookies for this task will not cause conflicts with other uses of rundir. If there is a problem, either:

  2. Run the script:
    cd rundir
    ./delete_project.sh protocol://host:port pid
    where
    protocol is the protocol for your hub: http or https.
    host:port is the location of your hub.
    pid is the project ID for the project whose name you wish to change.
    You can find the project ID:
    • in the GUI Project page URL, which will be of the form http://hub_location/project/project_id.html, or
    • by deriving it based on the analysis ID from the most recent analysis of the project, which in turn is available:
      • in the URL specified at the end build/analysis command output, which will be of the form http://hub_location/analysis/analysis_id.html, or
      • by running the following command, where path/to/projname.prj_files/ is the analysis directory
        codesonar analysis_id.py path/to/projname.prj_files/
        or
      • in file path/to/projname.prj_files/aid.txt, where path/to/projname.prj_files/ is the analysis directory.
      For details, see Derive the project ID from the analysis directory, below.
    The script will output information about its progress.
  3. Attempt to open the project page protocol://host:port/project/pid.html in your web browser to confirm that the project is no longer available.

Invocation Example

Using the hub at http://[::1]:7341, delete the project with ID 3:

./delete_project.sh http://[::1]:7341 3

Troubleshooting

Get more verbose output For more verbose curl output, edit delete_project.sh so that curl is invoked with the -v flag. For example:
del_project(){
   "$CURL_CMD" -v -L --cookie-jar cookies.txt -d remove_project_id="$1" "$2"
}
No files downloaded If there is no HTML output, this indicates that cURL did not download anything. This can occur if you have an HTTPS-enabled hub with a self-signed hub server certificate. To instruct curl to accept self-signed certificates, edit delete_project.sh so that curl is invoked with the -k flag. For example:
del_project(){
  "$CURL_CMD" -k -L --cookie-jar cookies.txt -d remove_project_id="$1" "$2"
}
Downloaded files contain "Permission Denied" messages If there is an output HTML file but it contains a "Permission Denied" message rather than a page reporting successful deletion, this indicates that Anonymous does not have the required permissions. You will need to specify credentials for a user with these permissions.

Modifying the Script

You may wish to make one or more of the following modifications.

Stop printing the resulting HTML file to output

If you don't want to see the final HTML file notifying you of successful deletion as part of your script's output, you can redirect it to the null location by modifying your curl command. Note that if you make further changes that you need to debug later, you may wish to lift this suppression at least temporarily.

  1. Edit delete_project.sh so that curl is invoked with the -o flag and a suitable value.
    del_project(){
       "$CURL_CMD" -o /dev/null -L --cookie-jar cookies.txt -d remove_project_id="$1" "$2"
    }

Derive the project ID from the analysis directory

Instead of specifying the project ID on the command line, you can change the script to read the analysis directory from the command line and derive the project ID by reading the most recent analysis ID from the analysis directory, requesting the corresponding Analysis page from the hub, then reading the project ID from the Analysis page.

Because this approach requires the Analysis page for the analysis A in question, you must have the following permissions for A in addition to the required project permissions.

Once you have verified that you have these permissions, proceed as follows.

  1. Edit delete_project.sh so that the line setting ANALYSIS_ID is replaced with three lines:
    ANALYSIS_DIR=$2
    CSONAR_CMD=codesonar
    ANALYSIS_ID=$("$CSONAR_CMD" analysis_id.py "$ANALYSIS_DIR" | tr -d '\r')
    
    If it is not in your PATH, adjust the setting of CSONAR_CMD to include the full path to your codesonar executable.
  2. Delete the line setting PROJECT_HTML_URL and replace it with the following line setting ANALYSIS_HTML_URL.
    ANALYSIS_HTML_URL="${HUB}/analysis/${ANALYSIS_ID}.html"
  3. Insert the following code before the definition of del_project(). This new function downloads a page, searches it for the first occurrence of a partial Project page URL, then extracts the ID from the URL.
    get_project_id(){
        PROJ_ID=$("$CURL_CMD" "$2" \
                    | sed -n '/href="\/project\//p' \
                    | head -n1 \
                    | sed 's/.* href="\/project\/\([0-9]*\)\.html".*/\1/')
        # exit with an error if no Project ID found
        if test "${PROJ_ID}" = ""
        then
            echo "No Project ID found."
            echo "This probably means you do not have ANALYSIS_READ permission"
            echo "for the analysis and so cannot access $2."
            exit 1
        else
            eval "$1='${PROJ_ID}'"
        fi
    } 
  4. Insert the following code as the second to last line of the script (that is, the line before the del_project invocation). This calls the new get_project_id() function to derive the required Project ID and write it into the PROJECT_ID variable.
    get_project_id PROJECT_ID "${ANALYSIS_HTML_URL}" 
  5. When you invoke the script, specify the analysis directory as the second argument.

    For example: using the hub at http://[::1]:7341, delete the analysis whose analysis directory is /myprojects/projectX.prj_files/.

    ./delete_project.sh http://[::1]:7341 /myprojects/projectX.prj_files/

Provide credentials for a non-Anonymous user

If your hub is configured so that special user Anonymous does not have the required permissions, you will need to edit the script to submit credentials for a suitable hub user account.

We recommend using bearer authentication. Alternative mechanisms are described in the table below.

For bearer authentication, do the following.

  1. If you do not already have a suitable session and bearer token to use, generate them now.
    1. Navigate to the User Sessions page for your selected hub user account.
    2. Use the Create Session form to create a new session with a suitably long Expires setting.
      When you click Create Session, the page will be reloaded and the Bearer Token for your new session will be displayed at the top of the page.
      IMPORTANT: Make a note of the Bearer Token now. Once you refresh or navigate away from this page there will be no further opportunity to view the token.
    3. Save the bearer token to a file. The remainder of these instructions will refer to this file as path/to/bearerfile.
  2. Edit delete_project.sh to add the following setting after the ANALYSIS_HTML_URL setting.
    BEARER_TOKEN=$(cat path/to/bearerfile)
    where
    path/to/bearerfile is the path to the file containing the bearer token you want to use.
  3. Change the definition of del_project() to:
    del_project(){
      "$CURL_CMD" -H "Authorization: Bearer ${BEARER_TOKEN}" -L -d remove_project_id="$1" "$2"
    }
    
    Note that --cookie-jar cookies.txt has been removed: the HTTP redirects are all within the bearer session.

For more information about bearer authentication in CodeSonar, see User Sessions and Anonymous Sessions: Bearer Authentication.

If you don't want to use bearer authentication, you can choose one of the options from the following table.

Certificate If the hub is configured for certificate-based authentication, you can edit the script to specify a suitable user certificate.
  1. If the account does not already have a user certificate and key, generate them now.
  2. Edit delete_project.sh to add the following settings after the ANALYSIS_HTML_URL setting.
    CERT_PATH=path/to/usercert.pem
    KEY_PATH=path/to/certkey.pem
    
    where
    path/to/usercert.pem is the path to the hub user account's user certificate.
    path/to/certkey.pem is the path to the private key corresponding to the user certificate.
  3. Change the definition of del_project() to:
    del_project(){
      "$CURL_CMD" -k -X POST -d "sif_sign_in=yes&sif_use_tls=yes&sif_log_out_competitor=yes" --cert "$CERT_PATH" --key "$KEY_PATH" \
          -L --cookie-jar cookies.txt -d remove_project_id="$1" "$2"
    }
    
    Omit the -k argument if your hub's hub server certificate is not self-signed.
Hard-Coded Username/Password If you will be running the shell script under secure conditions, you may be willing to specify the account username and password directly in the script invocation.

For example, if your hub location is http://[::1]:7340 and the hub user account has username jean and password xyz123, the first argument to the script would be http://jean:xyz123@[::1]:7340.

Example: Use the hub user account with username jean and password xyz123 to authorize deleting the analysis with ID 3 on the hub at http://[::1]:7340:

./delete_project.sh http://jean:xyz123@[::1]:7340 3
Username and password must both be URL-encoded.
Username/Password: Other See the curl man page for alternative username/password authentication mechanisms.

See CodeSonar HTTP API: Authentication for more information on authentication strategies.

Writing Other Scripts

You can follow the overall structure of this script to create shell scripts that download other kinds of file from the hub.

In general, the process for constructing a script will be along the following lines.

  1. Determine the GUI page type you are interested in.
  2. Look at the the GUI reference page for your required page type to determine the following information.
    • The page's URL or URL scheme: use this to construct the URL or URLs for your script to download.
    • The alternative page output formats that are available: if you want to process pages in one of these formats rather than HTML, check that your required format is available and construct the download URLs accordingly.
    • The RBAC permissions required to access the page and its contents. If special user Anonymous does not have these permissions, the shell script will need to provide authentication credentials for a hub user account that has the permissions.
  3. If your script will be carrying out a task that modifies the hub database (adding, deleting, or modifying elements), inspect the GUI page HTML to look at the <form ... > element that provides access to the functionality you are interested in. Your script will need to include an HTTP POST request (via curl or similar) that corresponds to the one issued when the form is submitted.
  4. Make sure your shell script includes the following elements.
    • One or more download URLs, or a mechanism for constructing them.
    • Some way of handling the downloaded URLs: one of the following.
      • The location to which the URLs should be downloaded, or a way to obtain the location.
      • An explicit redirect to the null location.
      • No specific handling, so that the downloaded files are all part of the script output.
    • A curl invocation that acts on the the URL or URLs.
  5. See the troubleshooting notes above if you encounter problems.
  6. The shell script in this task is designed to be as portable as possible. If more sophisticated control constructs and shell tools are available on your system, you can use them to streamline your hub interaction scripts.
    You may also be interested in using Python scripts to interact with the hub: if you have no local Python installation, you can use the cspython executable shipped with CodeSonar.

Links


Note. This page contains references to HTTP API documentation, which is served directly by the hub and cannot be accessed via a file:// URL. For active HTTP API documentation links, start a hub (if one is not already running), then open the manual from the hub.

 

To report problems with this documentation, please visit https://support.codesecure.com/.