Ticket tracker with patchset contributions

A basic issue tracker styled as a hybrid of GitHub and BitBucket issues.
You may attach commits to an existing ticket or you can push a single
commit to create a *proposal* ticket.

Tickets keep track of patchsets (one or more commits) and allow patchset
rewriting (rebase, amend, squash) by detecing the non-fast-forward
update and assigning a new patchset number to the new commits.

Ticket tracker
--------------

The ticket tracker stores tickets as an append-only journal of changes.
The journals are deserialized and a ticket is built by applying the
journal entries.  Tickets are indexed using Apache Lucene and all
queries and searches are executed against this Lucene index.

There is one trade-off to this persistence design: user attributions are
non-relational.

What does that mean?  Each journal entry stores the username of the
author.  If the username changes in the user service, the journal entry
will not reflect that change because the values are hard-coded.

Here are a few reasons/justifications for this design choice:

1. commit identifications (author, committer, tagger) are non-relational
2. maintains the KISS principle
3. your favorite text editor can still be your administration tool

Persistence Choices
-------------------

**FileTicketService**: stores journals on the filesystem
**BranchTicketService**: stores journals on an orphan branch
**RedisTicketService**: stores journals in a Redis key-value datastore

It should be relatively straight-forward to develop other backends
(MongoDB, etc) as long as the journal design is preserved.

Pushing Commits
---------------

Each push to a ticket is identified as a patchset revision.  A patchset
revision may add commits to the patchset (fast-forward) OR a patchset
revision may rewrite history (rebase, squash, rebase+squash, or amend).
Patchset authors should not be afraid to polish, revise, and rewrite
their code before merging into the proposed branch.

Gitblit will create one ref for each patchset.  These refs are updated
for fast-forward pushes or created for rewrites.  They are formatted as
`refs/tickets/{shard}/{id}/{patchset}`.  The *shard*  is the last two
digits of the id.  If the id < 10, prefix a 0.  The *shard* is always
two digits long.  The shard's purpose is to ensure Gitblit doesn't
exceed any filesystem directory limits for file creation.

**Creating a Proposal Ticket**

You may create a new change proposal ticket just by pushing a **single
commit** to `refs/for/{branch}` where branch is the proposed integration
branch OR `refs/for/new` or `refs/for/default` which both will use the
default repository branch.

    git push origin HEAD:refs/for/new

**Updating a Patchset**

The safe way to update an existing patchset is to push to the patchset
ref.

    git push origin HEAD:refs/heads/ticket/{id}

This ensures you do not accidentally create a new patchset in the event
that the patchset was updated after you last pulled.

The not-so-safe way to update an existing patchset is to push using the
magic ref.

    git push origin HEAD:refs/for/{id}

This push ref will update an exisitng patchset OR create a new patchset
if the update is non-fast-forward.

**Rebasing, Squashing, Amending**

Gitblit makes rebasing, squashing, and amending patchsets easy.

Normally, pushing a non-fast-forward update would require rewind (RW+)
repository permissions.  Gitblit provides a magic ref which will allow
ticket participants to rewrite a ticket patchset as long as the ticket
is open.

    git push origin HEAD:refs/for/{id}

Pushing changes to this ref allows the patchset authors to rebase,
squash, or amend the patchset commits without requiring client-side use
of the *--force* flag on push AND without requiring RW+ permission to
the repository.  Since each patchset is tracked with a ref it is easy to
recover from accidental non-fast-forward updates.

Features
--------

- Ticket tracker with status changes and responsible assignments
- Patchset revision scoring mechanism
- Update/Rewrite patchset handling
- Close-on-push detection
- Server-side Merge button for simple merges
- Comments with Markdown syntax support
- Rich mail notifications
- Voting
- Mentions
- Watch lists
- Querying
- Searches
- Partial miletones support
- Multiple backend options

1 files changed, 201 insertions, 0 deletions

diff --git a/src/main/java/com/gitblit/servlet/PtServlet.java b/src/main/java/com/gitblit/servlet/PtServlet.java
new file mode 100644
index 00000000..e9cbaa5b
--- /dev/null
+++ b/src/main/java/com/gitblit/servlet/PtServlet.java
@@ -0,0 +1,201 @@
+/*

+ * Copyright 2014 gitblit.com.

+ *

+ * Licensed under the Apache License, Version 2.0 (the "License");

+ * you may not use this file except in compliance with the License.

+ * You may obtain a copy of the License at

+ *

+ *     http://www.apache.org/licenses/LICENSE-2.0

+ *

+ * Unless required by applicable law or agreed to in writing, software

+ * distributed under the License is distributed on an "AS IS" BASIS,

+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

+ * See the License for the specific language governing permissions and

+ * limitations under the License.

+ */

+package com.gitblit.servlet;

+

+import java.io.File;

+import java.io.FileInputStream;

+import java.io.IOException;

+import java.io.InputStream;

+import java.io.OutputStream;

+

+import javax.servlet.ServletException;

+import javax.servlet.http.HttpServletRequest;

+import javax.servlet.http.HttpServletResponse;

+

+import org.apache.commons.compress.archivers.tar.TarArchiveEntry;

+import org.apache.commons.compress.archivers.tar.TarArchiveOutputStream;

+import org.apache.commons.compress.archivers.zip.ZipArchiveEntry;

+import org.apache.commons.compress.archivers.zip.ZipArchiveOutputStream;

+import org.apache.commons.compress.compressors.CompressorOutputStream;

+import org.apache.commons.compress.compressors.CompressorStreamFactory;

+import org.apache.wicket.util.io.ByteArrayOutputStream;

+import org.eclipse.jgit.lib.FileMode;

+

+import com.gitblit.dagger.DaggerServlet;

+import com.gitblit.manager.IRuntimeManager;

+

+import dagger.ObjectGraph;

+

+/**

+ * Handles requests for the Barnum pt (patchset tool).

+ *

+ * The user-agent determines the content and compression format.

+ *

+ * @author James Moger

+ *

+ */

+public class PtServlet extends DaggerServlet {

+

+	private static final long serialVersionUID = 1L;

+

+	private static final long lastModified = System.currentTimeMillis();

+

+	private IRuntimeManager runtimeManager;

+

+	@Override

+	protected void inject(ObjectGraph dagger) {

+		this.runtimeManager = dagger.get(IRuntimeManager.class);

+	}

+

+	@Override

+	protected long getLastModified(HttpServletRequest req) {

+		File file = runtimeManager.getFileOrFolder("tickets.pt", "${baseFolder}/pt.py");

+		if (file.exists()) {

+			return Math.max(lastModified, file.lastModified());

+		} else {

+			return lastModified;

+		}

+	}

+

+	@Override

+	protected void doGet(HttpServletRequest request, HttpServletResponse response)

+			throws ServletException, IOException {

+		try {

+			response.setContentType("application/octet-stream");

+			response.setDateHeader("Last-Modified", lastModified);

+			response.setHeader("Cache-Control", "none");

+			response.setHeader("Pragma", "no-cache");

+			response.setDateHeader("Expires", 0);

+

+			boolean windows = false;

+			try {

+				String useragent = request.getHeader("user-agent").toString();

+				windows = useragent.toLowerCase().contains("windows");

+			} catch (Exception e) {

+			}

+

+			byte[] pyBytes;

+			File file = runtimeManager.getFileOrFolder("tickets.pt", "${baseFolder}/pt.py");

+			if (file.exists()) {

+				// custom script

+				pyBytes = readAll(new FileInputStream(file));

+			} else {

+				// default script

+				pyBytes = readAll(getClass().getResourceAsStream("/pt.py"));

+			}

+

+			if (windows) {

+				// windows: download zip file with pt.py and pt.cmd

+				response.setHeader("Content-Disposition", "attachment; filename=\"pt.zip\"");

+

+				OutputStream os = response.getOutputStream();

+				ZipArchiveOutputStream zos = new ZipArchiveOutputStream(os);

+

+				// add the Python script

+				ZipArchiveEntry pyEntry = new ZipArchiveEntry("pt.py");

+				pyEntry.setSize(pyBytes.length);

+				pyEntry.setUnixMode(FileMode.EXECUTABLE_FILE.getBits());

+				pyEntry.setTime(lastModified);

+				zos.putArchiveEntry(pyEntry);

+				zos.write(pyBytes);

+				zos.closeArchiveEntry();

+

+				// add a Python launch cmd file

+				byte [] cmdBytes = readAll(getClass().getResourceAsStream("/pt.cmd"));

+				ZipArchiveEntry cmdEntry = new ZipArchiveEntry("pt.cmd");

+				cmdEntry.setSize(cmdBytes.length);

+				cmdEntry.setUnixMode(FileMode.REGULAR_FILE.getBits());

+				cmdEntry.setTime(lastModified);

+				zos.putArchiveEntry(cmdEntry);

+				zos.write(cmdBytes);

+				zos.closeArchiveEntry();

+

+				// add a brief readme

+				byte [] txtBytes = readAll(getClass().getResourceAsStream("/pt.txt"));

+				ZipArchiveEntry txtEntry = new ZipArchiveEntry("readme.txt");

+				txtEntry.setSize(txtBytes.length);

+				txtEntry.setUnixMode(FileMode.REGULAR_FILE.getBits());

+				txtEntry.setTime(lastModified);

+				zos.putArchiveEntry(txtEntry);

+				zos.write(txtBytes);

+				zos.closeArchiveEntry();

+

+				// cleanup

+				zos.finish();

+				zos.close();

+				os.flush();

+			} else {

+				// unix: download a tar.gz file with pt.py set with execute permissions

+				response.setHeader("Content-Disposition", "attachment; filename=\"pt.tar.gz\"");

+

+				OutputStream os = response.getOutputStream();

+				CompressorOutputStream cos = new CompressorStreamFactory().createCompressorOutputStream(CompressorStreamFactory.GZIP, os);

+				TarArchiveOutputStream tos = new TarArchiveOutputStream(cos);

+				tos.setAddPaxHeadersForNonAsciiNames(true);

+				tos.setLongFileMode(TarArchiveOutputStream.LONGFILE_POSIX);

+

+				// add the Python script

+				TarArchiveEntry pyEntry = new TarArchiveEntry("pt");

+				pyEntry.setMode(FileMode.EXECUTABLE_FILE.getBits());

+				pyEntry.setModTime(lastModified);

+				pyEntry.setSize(pyBytes.length);

+				tos.putArchiveEntry(pyEntry);

+				tos.write(pyBytes);

+				tos.closeArchiveEntry();

+

+				// add a brief readme

+				byte [] txtBytes = readAll(getClass().getResourceAsStream("/pt.txt"));

+				TarArchiveEntry txtEntry = new TarArchiveEntry("README");

+				txtEntry.setMode(FileMode.REGULAR_FILE.getBits());

+				txtEntry.setModTime(lastModified);

+				txtEntry.setSize(txtBytes.length);

+				tos.putArchiveEntry(txtEntry);

+				tos.write(txtBytes);

+				tos.closeArchiveEntry();

+

+				// cleanup

+				tos.finish();

+				tos.close();

+				cos.close();

+				os.flush();

+			}

+		} catch (Exception e) {

+			e.printStackTrace();

+		}

+	}

+

+	byte [] readAll(InputStream is) {

+		ByteArrayOutputStream os = new ByteArrayOutputStream();

+		try {

+			byte [] buffer = new byte[4096];

+			int len = 0;

+			while ((len = is.read(buffer)) > -1) {

+				os.write(buffer, 0, len);

+			}

+			return os.toByteArray();

+		} catch (IOException e) {

+			e.printStackTrace();

+		} finally {

+			try {

+				os.close();

+				is.close();

+			} catch (Exception e) {

+				// ignore

+			}

+		}

+		return new byte[0];

+	}

+}